Skip to content

Don't recalculate chunk offsets for ChunkedReader#8231

Merged
myrrc merged 1 commit into
developfrom
myrrc/chunked-layout-offsets
Jun 3, 2026
Merged

Don't recalculate chunk offsets for ChunkedReader#8231
myrrc merged 1 commit into
developfrom
myrrc/chunked-layout-offsets

Conversation

@myrrc

@myrrc myrrc commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Reuse them from parent layout.

@myrrc myrrc added the action/benchmark Trigger full benchmarks to run on this PR label Jun 3, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 3, 2026
@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 6c1444c 2 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done 6c1444c 1 Explore Profiling Data
🟢 Done ee43336 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.978x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.978x ➖, 1↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 116058565 117273546 0.99
polarsignals_q01/datafusion:vortex-file-compressed 261983409 274205440 0.96
polarsignals_q02/datafusion:vortex-file-compressed 🚀 21151737 23769899 0.89
polarsignals_q03/datafusion:vortex-file-compressed 276107591 256415974 1.08
polarsignals_q04/datafusion:vortex-file-compressed 10360341 10499151 0.99
polarsignals_q05/datafusion:vortex-file-compressed 14023209 14697474 0.95
polarsignals_q06/datafusion:vortex-file-compressed 17664086 17445355 1.01
polarsignals_q07/datafusion:vortex-file-compressed 12970576 12787201 1.01
polarsignals_q08/datafusion:vortex-file-compressed 393790498 405789526 0.97
polarsignals_q09/datafusion:vortex-file-compressed 9863983 10433184 0.95

No file size changes detected.

@codspeed-hq

codspeed-hq Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will improve performance by 30.15%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 3 improved benchmarks
✅ 1272 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Simulation chunked_bool_canonical_into[(1000, 10)] 45.4 µs 30.4 µs +49.27%
⚡ Simulation chunked_varbinview_canonical_into[(1000, 10)] 197.7 µs 161.4 µs +22.44%
⚡ Simulation chunked_varbinview_into_canonical[(1000, 10)] 212.3 µs 176 µs +20.64%

Tip

Curious why this is faster? Comment @codspeedbot explain why this is faster on this PR, or directly use the CodSpeed MCP with your agent.

Comparing myrrc/chunked-layout-offsets (6c1444c) with develop (2d00342)

Open in CodSpeed

@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -8.1%
Engines: DataFusion No clear signal (-11.9%, environment too noisy confidence) · DuckDB No clear signal (-4.1%, environment too noisy confidence)
Vortex (geomean): 0.928x ➖
Parquet (geomean): 1.010x ➖
Shifts: Parquet (control) +1.0% · Median polish -5.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.939x ➖, 4↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 6560585 6514639 1.01
fineweb_q01/datafusion:vortex-file-compressed 34935390 34791026 1.00
fineweb_q02/datafusion:vortex-file-compressed 41756300 44203088 0.94
fineweb_q03/datafusion:vortex-file-compressed 72907806 70815236 1.03
fineweb_q04/datafusion:vortex-file-compressed 309768464 301859404 1.03
fineweb_q05/datafusion:vortex-file-compressed 🚀 222313391 261812514 0.85
fineweb_q06/datafusion:vortex-file-compressed 🚀 51203956 57212626 0.89
fineweb_q07/datafusion:vortex-file-compressed 🚀 53026778 62043234 0.85
fineweb_q08/datafusion:vortex-file-compressed 🚀 20449216 23721010 0.86
datafusion / vortex-compact (0.939x ➖, 1↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5666490 6245246 0.91
fineweb_q01/datafusion:vortex-compact 97412163 100551313 0.97
fineweb_q02/datafusion:vortex-compact 109143774 105763966 1.03
fineweb_q03/datafusion:vortex-compact 887659670 914625011 0.97
fineweb_q04/datafusion:vortex-compact 927893801 1009314573 0.92
fineweb_q05/datafusion:vortex-compact 833725839 886748298 0.94
fineweb_q06/datafusion:vortex-compact 466292862 492356518 0.95
fineweb_q07/datafusion:vortex-compact 495244069 505861589 0.98
fineweb_q08/datafusion:vortex-compact 🚀 18538849 23130389 0.80
datafusion / parquet (1.066x ➖, 0↑ 3↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7890835 8477704 0.93
fineweb_q01/datafusion:parquet 🚨 340750347 305770082 1.11
fineweb_q02/datafusion:parquet 🚨 340475636 309237311 1.10
fineweb_q03/datafusion:parquet 🚨 332582369 294527804 1.13
fineweb_q04/datafusion:parquet 346372588 326685800 1.06
fineweb_q05/datafusion:parquet 343386798 323991650 1.06
fineweb_q06/datafusion:parquet 332929326 310415568 1.07
fineweb_q07/datafusion:parquet 318049228 299170053 1.06
fineweb_q08/datafusion:parquet 316506389 294730749 1.07
duckdb / vortex-file-compressed (0.917x ➖, 4↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3685068 4019353 0.92
fineweb_q01/duckdb:vortex-file-compressed 🚀 33209992 37373242 0.89
fineweb_q02/duckdb:vortex-file-compressed 40113233 40498078 0.99
fineweb_q03/duckdb:vortex-file-compressed 166035789 181163641 0.92
fineweb_q04/duckdb:vortex-file-compressed 278628602 295150084 0.94
fineweb_q05/duckdb:vortex-file-compressed 224707486 239119218 0.94
fineweb_q06/duckdb:vortex-file-compressed 🚀 51877910 58237016 0.89
fineweb_q07/duckdb:vortex-file-compressed 🚀 58996898 66680832 0.88
fineweb_q08/duckdb:vortex-file-compressed 🚀 21826594 24549516 0.89
duckdb / vortex-compact (0.919x ➖, 3↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚀 4384920 4915727 0.89
fineweb_q01/duckdb:vortex-compact 🚀 111241109 134937001 0.82
fineweb_q02/duckdb:vortex-compact 117036131 118212945 0.99
fineweb_q03/duckdb:vortex-compact 878770646 967635824 0.91
fineweb_q04/duckdb:vortex-compact 942156995 980618186 0.96
fineweb_q05/duckdb:vortex-compact 837938091 897617004 0.93
fineweb_q06/duckdb:vortex-compact 480956608 502332301 0.96
fineweb_q07/duckdb:vortex-compact 497521728 530135972 0.94
fineweb_q08/duckdb:vortex-compact 🚀 20185019 22953765 0.88
duckdb / parquet (0.957x ➖, 2↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 34226968 35405667 0.97
fineweb_q01/duckdb:parquet 🚀 87761499 98234013 0.89
fineweb_q02/duckdb:parquet 90257325 97007453 0.93
fineweb_q03/duckdb:parquet 🚀 324871755 367971857 0.88
fineweb_q04/duckdb:parquet 455103729 477127342 0.95
fineweb_q05/duckdb:parquet 422323334 427751364 0.99
fineweb_q06/duckdb:parquet 212748771 217135030 0.98
fineweb_q07/duckdb:parquet 225694047 225320094 1.00
fineweb_q08/duckdb:parquet 37515795 36384789 1.03
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB 976.65 KB -0.1%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (-0.1%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -9.3% -5.1% -4.3% +48.0% ➖ noise
0 datafusion:vortex-file-compressed +0.7% -5.1% +6.2% +51.3% ➖ noise
0 duckdb:vortex-compact -10.8% -5.1% -6.0% +47.8% ➖ noise
0 duckdb:vortex-file-compressed -8.3% -5.1% -3.3% +72.5% ➖ noise
1 datafusion:vortex-compact -3.1% -0.2% -2.9% +11.7% ➖ noise
1 datafusion:vortex-file-compressed +0.4% -0.2% +0.6% +15.6% ➖ noise
1 duckdb:vortex-compact -17.6% -0.2% -17.4% +19.6% ✅ faster
1 duckdb:vortex-file-compressed -11.1% -0.2% -10.9% +45.8% ➖ noise
2 datafusion:vortex-compact +3.2% +1.2% +2.0% +12.8% ➖ noise
2 datafusion:vortex-file-compressed -5.5% +1.2% -6.7% +14.3% ➖ noise
2 duckdb:vortex-compact -1.0% +1.2% -2.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -1.0% +1.2% -2.1% +11.2% ➖ noise
3 datafusion:vortex-compact -2.9% -0.2% -2.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +3.0% -0.2% +3.1% +22.4% ➖ noise
3 duckdb:vortex-compact -9.2% -0.2% -9.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -8.4% -0.2% -8.2% +31.3% ➖ noise
4 datafusion:vortex-compact -8.1% +0.6% -8.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.6% +0.6% +2.0% +10.0% ➖ noise
4 duckdb:vortex-compact -3.9% +0.6% -4.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -5.6% +0.6% -6.1% +10.0% ➖ noise
5 datafusion:vortex-compact -6.0% +2.3% -8.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -15.1% +2.3% -17.0% +10.0% ✅ faster
5 duckdb:vortex-compact -6.6% +2.3% -8.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -6.0% +2.3% -8.1% +10.0% ➖ noise
6 datafusion:vortex-compact -5.3% +2.5% -7.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -10.5% +2.5% -12.7% +10.7% ✅ faster
6 duckdb:vortex-compact -4.3% +2.5% -6.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -10.9% +2.5% -13.1% +20.0% ➖ noise
7 datafusion:vortex-compact -2.1% +3.2% -5.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -14.5% +3.2% -17.2% +15.5% ✅ faster
7 duckdb:vortex-compact -6.2% +3.2% -9.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -11.5% +3.2% -14.3% +18.6% ➖ noise
8 datafusion:vortex-compact -19.9% +5.2% -23.8% +11.9% ✅ faster
8 datafusion:vortex-file-compressed -13.8% +5.2% -18.1% +39.5% ➖ noise
8 duckdb:vortex-compact -12.1% +5.2% -16.4% +60.0% ➖ noise
8 duckdb:vortex-file-compressed -11.1% +5.2% -15.5% +49.1% ➖ noise

@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.4%
Engines: DataFusion No clear signal (-0.6%, environment too noisy confidence) · DuckDB No clear signal (+3.5%, environment too noisy confidence)
Vortex (geomean): 1.005x ➖
Parquet (geomean): 1.015x ➖
Shifts: Parquet (control) +1.5% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.961x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51663634 52092305 0.99
tpch_q02/datafusion:vortex-file-compressed 23090166 24322013 0.95
tpch_q03/datafusion:vortex-file-compressed 28048052 29658089 0.95
tpch_q04/datafusion:vortex-file-compressed 21135661 21573908 0.98
tpch_q05/datafusion:vortex-file-compressed 50299591 55623964 0.90
tpch_q06/datafusion:vortex-file-compressed 10731820 11654456 0.92
tpch_q07/datafusion:vortex-file-compressed 56797308 58991651 0.96
tpch_q08/datafusion:vortex-file-compressed 41341853 43242247 0.96
tpch_q09/datafusion:vortex-file-compressed 53328574 55506457 0.96
tpch_q10/datafusion:vortex-file-compressed 45977593 46136301 1.00
tpch_q11/datafusion:vortex-file-compressed 16638451 17397069 0.96
tpch_q12/datafusion:vortex-file-compressed 25503730 25965897 0.98
tpch_q13/datafusion:vortex-file-compressed 27641133 28003918 0.99
tpch_q14/datafusion:vortex-file-compressed 16152249 17271752 0.94
tpch_q15/datafusion:vortex-file-compressed 25108859 25520690 0.98
tpch_q16/datafusion:vortex-file-compressed 20923800 21672051 0.97
tpch_q17/datafusion:vortex-file-compressed 69097818 71556766 0.97
tpch_q18/datafusion:vortex-file-compressed 84640388 90659880 0.93
tpch_q19/datafusion:vortex-file-compressed 21127942 21742051 0.97
tpch_q20/datafusion:vortex-file-compressed 31721475 31172020 1.02
tpch_q21/datafusion:vortex-file-compressed 72431194 77252744 0.94
tpch_q22/datafusion:vortex-file-compressed 12116057 12697442 0.95
datafusion / vortex-compact (1.046x ➖, 0↑ 4↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58229915 59345431 0.98
tpch_q02/datafusion:vortex-compact 26415125 27240913 0.97
tpch_q03/datafusion:vortex-compact 29459898 30156709 0.98
tpch_q04/datafusion:vortex-compact 22979759 23602516 0.97
tpch_q05/datafusion:vortex-compact 51527948 53403276 0.96
tpch_q06/datafusion:vortex-compact 13189535 13081104 1.01
tpch_q07/datafusion:vortex-compact 60193562 61774300 0.97
tpch_q08/datafusion:vortex-compact 44240160 44734643 0.99
tpch_q09/datafusion:vortex-compact 56232748 56267485 1.00
tpch_q10/datafusion:vortex-compact 50469490 48320995 1.04
tpch_q11/datafusion:vortex-compact 🚨 24337015 17760588 1.37
tpch_q12/datafusion:vortex-compact 🚨 39256969 31523462 1.25
tpch_q13/datafusion:vortex-compact 🚨 40070878 33256175 1.20
tpch_q14/datafusion:vortex-compact 🚨 23015397 19684323 1.17
tpch_q15/datafusion:vortex-compact 33005624 32437208 1.02
tpch_q16/datafusion:vortex-compact 28074550 26210128 1.07
tpch_q17/datafusion:vortex-compact 79275597 72090229 1.10
tpch_q18/datafusion:vortex-compact 90352446 88928472 1.02
tpch_q19/datafusion:vortex-compact 32815381 31281962 1.05
tpch_q20/datafusion:vortex-compact 35384594 36128284 0.98
tpch_q21/datafusion:vortex-compact 79207850 79014631 1.00
tpch_q22/datafusion:vortex-compact 13263932 13302122 1.00
datafusion / parquet (1.053x ➖, 1↑ 6↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 157303808 115990823 1.36
tpch_q02/datafusion:parquet 🚨 89644299 65403012 1.37
tpch_q03/datafusion:parquet 🚨 89971417 73398379 1.23
tpch_q04/datafusion:parquet 🚨 58734152 45300944 1.30
tpch_q05/datafusion:parquet 🚨 115187504 97792037 1.18
tpch_q06/datafusion:parquet 44018138 40389969 1.09
tpch_q07/datafusion:parquet 114844002 109353302 1.05
tpch_q08/datafusion:parquet 100874291 101525889 0.99
tpch_q09/datafusion:parquet 133530334 133525870 1.00
tpch_q10/datafusion:parquet 116599248 117353059 0.99
tpch_q11/datafusion:parquet 42789868 43612765 0.98
tpch_q12/datafusion:parquet 85576963 79180164 1.08
tpch_q13/datafusion:parquet 202824469 215831675 0.94
tpch_q14/datafusion:parquet 49158563 48267092 1.02
tpch_q15/datafusion:parquet 64570901 63998016 1.01
tpch_q16/datafusion:parquet 42234326 43400296 0.97
tpch_q17/datafusion:parquet 🚀 129036965 156448795 0.82
tpch_q18/datafusion:parquet 168161674 172036284 0.98
tpch_q19/datafusion:parquet 🚨 72176954 63336596 1.14
tpch_q20/datafusion:parquet 71139809 73774317 0.96
tpch_q21/datafusion:parquet 136194865 147175844 0.93
tpch_q22/datafusion:parquet 31459190 32338759 0.97
datafusion / arrow (1.142x ❌, 3↑ 11↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 54398981 65106898 0.84
tpch_q02/datafusion:arrow 18863191 20632294 0.91
tpch_q03/datafusion:arrow 29138694 31536782 0.92
tpch_q04/datafusion:arrow 25291096 27256069 0.93
tpch_q05/datafusion:arrow 80963247 78948318 1.03
tpch_q06/datafusion:arrow 20122124 20844576 0.97
tpch_q07/datafusion:arrow 105239395 108506620 0.97
tpch_q08/datafusion:arrow 43465588 47291971 0.92
tpch_q09/datafusion:arrow 🚀 64283260 73825828 0.87
tpch_q10/datafusion:arrow 🚀 44852274 54486103 0.82
tpch_q11/datafusion:arrow 8983096 9737299 0.92
tpch_q12/datafusion:arrow 🚨 79759717 57134185 1.40
tpch_q13/datafusion:arrow 🚨 54098343 48485810 1.12
tpch_q14/datafusion:arrow 🚨 41465467 23760391 1.75
tpch_q15/datafusion:arrow 🚨 80268212 48225522 1.66
tpch_q16/datafusion:arrow 🚨 24374355 19904017 1.22
tpch_q17/datafusion:arrow 🚨 105068843 73870917 1.42
tpch_q18/datafusion:arrow 🚨 200857291 146760867 1.37
tpch_q19/datafusion:arrow 🚨 64836427 38177185 1.70
tpch_q20/datafusion:arrow 🚨 54341821 36904558 1.47
tpch_q21/datafusion:arrow 🚨 248534987 164530345 1.51
tpch_q22/datafusion:arrow 🚨 22127816 18706663 1.18
duckdb / vortex-file-compressed (1.033x ➖, 0↑ 3↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31657934 32050216 0.99
tpch_q02/duckdb:vortex-file-compressed 26141023 26669925 0.98
tpch_q03/duckdb:vortex-file-compressed 34656416 34170667 1.01
tpch_q04/duckdb:vortex-file-compressed 🚨 37515719 30126446 1.25
tpch_q05/duckdb:vortex-file-compressed 🚨 51307761 39676784 1.29
tpch_q06/duckdb:vortex-file-compressed 🚨 10719795 8906442 1.20
tpch_q07/duckdb:vortex-file-compressed 39496753 36972909 1.07
tpch_q08/duckdb:vortex-file-compressed 39453961 38989280 1.01
tpch_q09/duckdb:vortex-file-compressed 61635540 60197641 1.02
tpch_q10/duckdb:vortex-file-compressed 43800735 42197159 1.04
tpch_q11/duckdb:vortex-file-compressed 15748976 15462572 1.02
tpch_q12/duckdb:vortex-file-compressed 22882666 22754646 1.01
tpch_q13/duckdb:vortex-file-compressed 43558355 43504303 1.00
tpch_q14/duckdb:vortex-file-compressed 22873811 22871776 1.00
tpch_q15/duckdb:vortex-file-compressed 17546353 17554955 1.00
tpch_q16/duckdb:vortex-file-compressed 30966364 31287695 0.99
tpch_q17/duckdb:vortex-file-compressed 24760480 25741243 0.96
tpch_q18/duckdb:vortex-file-compressed 54488324 55282166 0.99
tpch_q19/duckdb:vortex-file-compressed 30409022 31164009 0.98
tpch_q20/duckdb:vortex-file-compressed 33888908 35647139 0.95
tpch_q21/duckdb:vortex-file-compressed 106484203 105720516 1.01
tpch_q22/duckdb:vortex-file-compressed 18706001 18044460 1.04
duckdb / vortex-compact (0.982x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 38707564 39717697 0.97
tpch_q02/duckdb:vortex-compact 34592611 34629555 1.00
tpch_q03/duckdb:vortex-compact 35576262 36789999 0.97
tpch_q04/duckdb:vortex-compact 31791772 31980403 0.99
tpch_q05/duckdb:vortex-compact 41840258 44211014 0.95
tpch_q06/duckdb:vortex-compact 11546153 10973617 1.05
tpch_q07/duckdb:vortex-compact 41794100 43194519 0.97
tpch_q08/duckdb:vortex-compact 43227730 43025857 1.00
tpch_q09/duckdb:vortex-compact 66803652 68129327 0.98
tpch_q10/duckdb:vortex-compact 45933085 49887074 0.92
tpch_q11/duckdb:vortex-compact 19013733 18938067 1.00
tpch_q12/duckdb:vortex-compact 30528258 30691309 0.99
tpch_q13/duckdb:vortex-compact 47799545 48765145 0.98
tpch_q14/duckdb:vortex-compact 26940004 27807425 0.97
tpch_q15/duckdb:vortex-compact 19938567 20438707 0.98
tpch_q16/duckdb:vortex-compact 34130445 33570413 1.02
tpch_q17/duckdb:vortex-compact 30112088 31242314 0.96
tpch_q18/duckdb:vortex-compact 54787341 55231938 0.99
tpch_q19/duckdb:vortex-compact 34756356 35207610 0.99
tpch_q20/duckdb:vortex-compact 39675578 42771028 0.93
tpch_q21/duckdb:vortex-compact 106839305 109328686 0.98
tpch_q22/duckdb:vortex-compact 19521702 19053475 1.02
duckdb / parquet (0.978x ➖, 3↑ 1↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77376695 79478473 0.97
tpch_q02/duckdb:parquet 40541607 40192819 1.01
tpch_q03/duckdb:parquet 72160862 72130190 1.00
tpch_q04/duckdb:parquet 51106874 50878025 1.00
tpch_q05/duckdb:parquet 69998244 70003009 1.00
tpch_q06/duckdb:parquet 22441684 22800402 0.98
tpch_q07/duckdb:parquet 🚀 71499044 84009722 0.85
tpch_q08/duckdb:parquet 84402633 87080759 0.97
tpch_q09/duckdb:parquet 159400387 151263041 1.05
tpch_q10/duckdb:parquet 129223601 133590432 0.97
tpch_q11/duckdb:parquet 23282609 23367161 1.00
tpch_q12/duckdb:parquet 🚀 47805024 59945558 0.80
tpch_q13/duckdb:parquet 268010138 268248118 1.00
tpch_q14/duckdb:parquet 52460895 53057648 0.99
tpch_q15/duckdb:parquet 27004719 26746787 1.01
tpch_q16/duckdb:parquet 59689730 61352864 0.97
tpch_q17/duckdb:parquet 🚀 52385565 62913538 0.83
tpch_q18/duckdb:parquet 121951860 123119140 0.99
tpch_q19/duckdb:parquet 🚨 91034573 73895062 1.23
tpch_q20/duckdb:parquet 65991476 67028178 0.98
tpch_q21/duckdb:parquet 187393194 194047316 0.97
tpch_q22/duckdb:parquet 54572950 54659245 1.00
duckdb / duckdb (1.021x ➖, 0↑ 1↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 18205031 17965225 1.01
tpch_q02/duckdb:duckdb 15263480 15391229 0.99
tpch_q03/duckdb:duckdb 23941221 24250634 0.99
tpch_q04/duckdb:duckdb 23522663 23591908 1.00
tpch_q05/duckdb:duckdb 24659142 24092990 1.02
tpch_q06/duckdb:duckdb 7283766 7210049 1.01
tpch_q07/duckdb:duckdb 26607470 26275570 1.01
tpch_q08/duckdb:duckdb 24948414 25181478 0.99
tpch_q09/duckdb:duckdb 61605526 60668042 1.02
tpch_q10/duckdb:duckdb 🚨 65989338 51638855 1.28
tpch_q11/duckdb:duckdb 8247829 7542005 1.09
tpch_q12/duckdb:duckdb 19109257 18398869 1.04
tpch_q13/duckdb:duckdb 41683873 40729991 1.02
tpch_q14/duckdb:duckdb 22798508 21986921 1.04
tpch_q15/duckdb:duckdb 14136902 13885127 1.02
tpch_q16/duckdb:duckdb 27237764 26752690 1.02
tpch_q17/duckdb:duckdb 16753040 16992022 0.99
tpch_q18/duckdb:duckdb 41811188 41381709 1.01
tpch_q19/duckdb:duckdb 32474392 32846281 0.99
tpch_q20/duckdb:duckdb 25439588 25755053 0.99
tpch_q21/duckdb:duckdb 63406906 63181286 1.00
tpch_q22/duckdb:duckdb 25732770 26319092 0.98
File Size Changes (10 files changed, +0.1% overall, 3↑ 7↓)
File Scale Format Base HEAD Change %
orders_0.vortex 1.0 vortex-compact 31.73 MB 32.20 MB +482.27 KB +1.5%
partsupp_0.vortex 1.0 vortex-compact 20.75 MB 20.89 MB +144.45 KB +0.7%
orders_0.vortex 1.0 vortex-file-compressed 38.23 MB 38.26 MB +32.66 KB +0.1%
part_0.vortex 1.0 vortex-file-compressed 4.98 MB 4.98 MB 1.91 KB -0.0%
lineitem_1.vortex 1.0 vortex-file-compressed 84.66 MB 84.62 MB 45.25 KB -0.1%
partsupp_0.vortex 1.0 vortex-file-compressed 23.81 MB 23.80 MB 17.95 KB -0.1%
lineitem_0.vortex 1.0 vortex-file-compressed 85.11 MB 85.04 MB 71.63 KB -0.1%
supplier_0.vortex 1.0 vortex-file-compressed 605.34 KB 603.92 KB 1.42 KB -0.2%
customer_0.vortex 1.0 vortex-file-compressed 8.91 MB 8.88 MB 25.37 KB -0.3%
part_0.vortex 1.0 vortex-compact 3.47 MB 3.38 MB 85.70 KB -2.4%

Totals:

  • vortex-compact: 190.17 MB → 190.70 MB (+0.3%)
  • vortex-file-compressed: 246.57 MB → 246.44 MB (-0.1%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -16.4% +14.9% -27.3% +25.0% ✅ faster
1 datafusion:vortex-compact -1.9% +14.9% -14.6% +25.0% ➖ noise
1 datafusion:vortex-file-compressed -0.8% +14.9% -13.7% +25.0% ➖ noise
1 duckdb:duckdb +1.3% +14.9% -11.8% +25.0% ➖ noise
1 duckdb:vortex-compact -2.5% +14.9% -15.2% +25.0% ➖ noise
1 duckdb:vortex-file-compressed -1.2% +14.9% -14.0% +25.0% ➖ noise
2 datafusion:arrow -8.6% +17.6% -22.2% +25.0% ✅ faster
2 datafusion:vortex-compact -3.0% +17.6% -17.5% +25.0% ➖ noise
2 datafusion:vortex-file-compressed -5.1% +17.6% -19.3% +25.0% ➖ noise
2 duckdb:duckdb -0.8% +17.6% -15.7% +25.0% ➖ noise
2 duckdb:vortex-compact -0.1% +17.6% -15.0% +25.0% ➖ noise
2 duckdb:vortex-file-compressed -2.0% +17.6% -16.6% +25.0% ➖ noise
3 datafusion:arrow -7.6% +10.7% -16.6% +25.0% ➖ noise
3 datafusion:vortex-compact -2.3% +10.7% -11.8% +25.0% ➖ noise
3 datafusion:vortex-file-compressed -5.4% +10.7% -14.6% +25.0% ➖ noise
3 duckdb:duckdb -1.3% +10.7% -10.8% +25.0% ➖ noise
3 duckdb:vortex-compact -3.3% +10.7% -12.7% +25.0% ➖ noise
3 duckdb:vortex-file-compressed +1.4% +10.7% -8.4% +25.0% ➖ noise
4 datafusion:arrow -7.2% +14.1% -18.7% +25.0% ➖ noise
4 datafusion:vortex-compact -2.6% +14.1% -14.7% +25.0% ➖ noise
4 datafusion:vortex-file-compressed -2.0% +14.1% -14.2% +25.0% ➖ noise
4 duckdb:duckdb -0.3% +14.1% -12.6% +25.0% ➖ noise
4 duckdb:vortex-compact -0.6% +14.1% -12.9% +25.0% ➖ noise
4 duckdb:vortex-file-compressed +24.5% +14.1% +9.1% +25.0% ➖ noise
5 datafusion:arrow +2.6% +8.5% -5.5% +25.0% ➖ noise
5 datafusion:vortex-compact -3.5% +8.5% -11.1% +25.0% ➖ noise
5 datafusion:vortex-file-compressed -9.6% +8.5% -16.7% +25.0% ➖ noise
5 duckdb:duckdb +2.3% +8.5% -5.7% +25.0% ➖ noise
5 duckdb:vortex-compact -5.4% +8.5% -12.8% +25.0% ➖ noise
5 duckdb:vortex-file-compressed +29.3% +8.5% +19.2% +25.0% ➖ noise
6 datafusion:arrow -3.5% +3.6% -6.8% +25.0% ➖ noise
6 datafusion:vortex-compact +0.8% +3.6% -2.6% +25.0% ➖ noise
6 datafusion:vortex-file-compressed -7.9% +3.6% -11.1% +25.0% ➖ noise
6 duckdb:duckdb +1.0% +3.6% -2.5% +25.0% ➖ noise
6 duckdb:vortex-compact +5.2% +3.6% +1.6% +25.0% ➖ noise
6 duckdb:vortex-file-compressed +20.4% +3.6% +16.2% +25.0% ➖ noise
7 datafusion:arrow -3.0% -5.5% +2.6% +25.0% ➖ noise
7 datafusion:vortex-compact -2.6% -5.5% +3.1% +25.0% ➖ noise
7 datafusion:vortex-file-compressed -3.7% -5.5% +1.8% +25.0% ➖ noise
7 duckdb:duckdb +1.3% -5.5% +7.1% +25.0% ➖ noise
7 duckdb:vortex-compact -3.2% -5.5% +2.3% +25.0% ➖ noise
7 duckdb:vortex-file-compressed +6.8% -5.5% +13.0% +25.0% ➖ noise
8 datafusion:arrow -8.1% -1.9% -6.3% +25.0% ➖ noise
8 datafusion:vortex-compact -1.1% -1.9% +0.8% +25.0% ➖ noise
8 datafusion:vortex-file-compressed -4.4% -1.9% -2.6% +25.0% ➖ noise
8 duckdb:duckdb -0.9% -1.9% +1.0% +25.0% ➖ noise
8 duckdb:vortex-compact +0.5% -1.9% +2.4% +25.0% ➖ noise
8 duckdb:vortex-file-compressed +1.2% -1.9% +3.1% +25.0% ➖ noise
9 datafusion:arrow -12.9% +2.7% -15.2% +25.0% ➖ noise
9 datafusion:vortex-compact -0.1% +2.7% -2.6% +25.0% ➖ noise
9 datafusion:vortex-file-compressed -3.9% +2.7% -6.4% +25.0% ➖ noise
9 duckdb:duckdb +1.5% +2.7% -1.1% +25.0% ➖ noise
9 duckdb:vortex-compact -1.9% +2.7% -4.5% +25.0% ➖ noise
9 duckdb:vortex-file-compressed +2.4% +2.7% -0.3% +25.0% ➖ noise
10 datafusion:arrow -17.7% -2.0% -16.0% +25.0% ➖ noise
10 datafusion:vortex-compact +4.4% -2.0% +6.5% +25.0% ➖ noise
10 datafusion:vortex-file-compressed -0.3% -2.0% +1.7% +25.0% ➖ noise
10 duckdb:duckdb +27.8% -2.0% +30.4% +25.0% 🚨 regression
10 duckdb:vortex-compact -7.9% -2.0% -6.1% +25.0% ➖ noise
10 duckdb:vortex-file-compressed +3.8% -2.0% +5.9% +25.0% ➖ noise
11 datafusion:arrow -7.7% -1.1% -6.7% +25.0% ➖ noise
11 datafusion:vortex-compact +37.0% -1.1% +38.6% +25.0% 🚨 regression
11 datafusion:vortex-file-compressed -4.4% -1.1% -3.3% +25.0% ➖ noise
11 duckdb:duckdb +9.4% -1.1% +10.6% +25.0% ➖ noise
11 duckdb:vortex-compact +0.4% -1.1% +1.5% +25.0% ➖ noise
11 duckdb:vortex-file-compressed +1.9% -1.1% +3.0% +25.0% ➖ noise
12 datafusion:arrow +39.6% -7.2% +50.4% +25.0% 🚨 regression
12 datafusion:vortex-compact +24.5% -7.2% +34.1% +25.0% 🚨 regression
12 datafusion:vortex-file-compressed -1.8% -7.2% +5.8% +25.0% ➖ noise
12 duckdb:duckdb +3.9% -7.2% +11.9% +25.0% ➖ noise
12 duckdb:vortex-compact -0.5% -7.2% +7.1% +25.0% ➖ noise
12 duckdb:vortex-file-compressed +0.6% -7.2% +8.3% +25.0% ➖ noise
13 datafusion:arrow +11.6% -3.1% +15.1% +25.0% ➖ noise
13 datafusion:vortex-compact +20.5% -3.1% +24.4% +25.0% ➖ noise
13 datafusion:vortex-file-compressed -1.3% -3.1% +1.9% +25.0% ➖ noise
13 duckdb:duckdb +2.3% -3.1% +5.6% +25.0% ➖ noise
13 duckdb:vortex-compact -2.0% -3.1% +1.2% +25.0% ➖ noise
13 duckdb:vortex-file-compressed +0.1% -3.1% +3.3% +25.0% ➖ noise
14 datafusion:arrow +74.5% +0.4% +73.9% +26.4% 🚨 regression
14 datafusion:vortex-compact +16.9% +0.4% +16.5% +25.0% ➖ noise
14 datafusion:vortex-file-compressed -6.5% +0.4% -6.8% +25.0% ➖ noise
14 duckdb:duckdb +3.7% +0.4% +3.3% +25.0% ➖ noise
14 duckdb:vortex-compact -3.1% +0.4% -3.5% +25.0% ➖ noise
14 duckdb:vortex-file-compressed +0.0% +0.4% -0.3% +25.0% ➖ noise
15 datafusion:arrow +66.4% +0.9% +64.9% +25.0% 🚨 regression
15 datafusion:vortex-compact +1.8% +0.9% +0.8% +25.0% ➖ noise
15 datafusion:vortex-file-compressed -1.6% +0.9% -2.5% +25.0% ➖ noise
15 duckdb:duckdb +1.8% +0.9% +0.9% +25.0% ➖ noise
15 duckdb:vortex-compact -2.4% +0.9% -3.3% +25.0% ➖ noise
15 duckdb:vortex-file-compressed -0.0% +0.9% -1.0% +25.0% ➖ noise
16 datafusion:arrow +22.5% -2.7% +25.9% +25.0% 🚨 regression
16 datafusion:vortex-compact +7.1% -2.7% +10.1% +25.0% ➖ noise
16 datafusion:vortex-file-compressed -3.5% -2.7% -0.8% +25.0% ➖ noise
16 duckdb:duckdb +1.8% -2.7% +4.6% +25.0% ➖ noise
16 duckdb:vortex-compact +1.7% -2.7% +4.5% +25.0% ➖ noise
16 duckdb:vortex-file-compressed -1.0% -2.7% +1.7% +25.0% ➖ noise
17 datafusion:arrow +42.2% -17.1% +71.6% +25.0% 🚨 regression
17 datafusion:vortex-compact +10.0% -17.1% +32.7% +25.0% 🚨 regression
17 datafusion:vortex-file-compressed -3.4% -17.1% +16.5% +25.0% ➖ noise
17 duckdb:duckdb -1.4% -17.1% +19.0% +25.0% ➖ noise
17 duckdb:vortex-compact -3.6% -17.1% +16.3% +25.0% ➖ noise
17 duckdb:vortex-file-compressed -3.8% -17.1% +16.1% +25.0% ➖ noise
18 datafusion:arrow +36.9% -1.6% +39.1% +25.0% 🚨 regression
18 datafusion:vortex-compact +1.6% -1.6% +3.3% +25.0% ➖ noise
18 datafusion:vortex-file-compressed -6.6% -1.6% -5.1% +25.0% ➖ noise
18 duckdb:duckdb +1.0% -1.6% +2.7% +25.0% ➖ noise
18 duckdb:vortex-compact -0.8% -1.6% +0.8% +25.0% ➖ noise
18 duckdb:vortex-file-compressed -1.4% -1.6% +0.2% +25.0% ➖ noise
19 datafusion:arrow +69.8% +18.5% +43.3% +31.0% 🚨 regression
19 datafusion:vortex-compact +4.9% +18.5% -11.5% +25.0% ➖ noise
19 datafusion:vortex-file-compressed -2.8% +18.5% -18.0% +25.0% ➖ noise
19 duckdb:duckdb -1.1% +18.5% -16.6% +25.0% ➖ noise
19 duckdb:vortex-compact -1.3% +18.5% -16.7% +25.0% ➖ noise
19 duckdb:vortex-file-compressed -2.4% +18.5% -17.6% +25.0% ➖ noise
20 datafusion:arrow +47.2% -2.6% +51.1% +25.0% 🚨 regression
20 datafusion:vortex-compact -2.1% -2.6% +0.5% +25.0% ➖ noise
20 datafusion:vortex-file-compressed +1.8% -2.6% +4.4% +25.0% ➖ noise
20 duckdb:duckdb -1.2% -2.6% +1.4% +25.0% ➖ noise
20 duckdb:vortex-compact -7.2% -2.6% -4.8% +25.0% ➖ noise
20 duckdb:vortex-file-compressed -4.9% -2.6% -2.4% +25.0% ➖ noise
21 datafusion:arrow +51.1% -5.5% +59.8% +25.0% 🚨 regression
21 datafusion:vortex-compact +0.2% -5.5% +6.0% +25.0% ➖ noise
21 datafusion:vortex-file-compressed -6.2% -5.5% -0.8% +25.0% ➖ noise
21 duckdb:duckdb +0.4% -5.5% +6.2% +25.0% ➖ noise
21 duckdb:vortex-compact -2.3% -5.5% +3.4% +25.0% ➖ noise
21 duckdb:vortex-file-compressed +0.7% -5.5% +6.5% +25.0% ➖ noise
22 datafusion:arrow +18.3% -1.4% +20.0% +25.0% ➖ noise
22 datafusion:vortex-compact -0.3% -1.4% +1.2% +25.0% ➖ noise
22 datafusion:vortex-file-compressed -4.6% -1.4% -3.2% +25.0% ➖ noise
22 duckdb:duckdb -2.2% -1.4% -0.8% +25.0% ➖ noise
22 duckdb:vortex-compact +2.5% -1.4% +4.0% +25.0% ➖ noise
22 duckdb:vortex-file-compressed +3.7% -1.4% +5.2% +25.0% ➖ noise

@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (+0.5%, environment too noisy confidence) · DuckDB No clear signal (-1.9%, low confidence)
Vortex (geomean): 0.962x ➖
Parquet (geomean): 0.972x ➖
Shifts: Parquet (control) -2.8% · Median polish -2.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.941x ➖, 20↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚀 25114926 29945755 0.84
tpcds_q02/datafusion:vortex-file-compressed 🚀 46699887 52099453 0.90
tpcds_q03/datafusion:vortex-file-compressed 15845599 17439040 0.91
tpcds_q04/datafusion:vortex-file-compressed 🚀 252979520 290637407 0.87
tpcds_q05/datafusion:vortex-file-compressed 43637832 47664070 0.92
tpcds_q06/datafusion:vortex-file-compressed 59326744 60937108 0.97
tpcds_q07/datafusion:vortex-file-compressed 43058588 46827094 0.92
tpcds_q08/datafusion:vortex-file-compressed 🚀 29354165 33119843 0.89
tpcds_q09/datafusion:vortex-file-compressed 38052654 42072134 0.90
tpcds_q10/datafusion:vortex-file-compressed 🚀 38019738 44054420 0.86
tpcds_q11/datafusion:vortex-file-compressed 🚀 129635181 148208321 0.87
tpcds_q12/datafusion:vortex-file-compressed 🚀 18398234 23791830 0.77
tpcds_q13/datafusion:vortex-file-compressed 🚀 47561524 54084235 0.88
tpcds_q14/datafusion:vortex-file-compressed 🚀 170514922 193801117 0.88
tpcds_q15/datafusion:vortex-file-compressed 🚀 27776329 31939928 0.87
tpcds_q16/datafusion:vortex-file-compressed 🚀 28207989 34764330 0.81
tpcds_q17/datafusion:vortex-file-compressed 🚀 64272435 73141869 0.88
tpcds_q18/datafusion:vortex-file-compressed 🚀 69854543 79250204 0.88
tpcds_q19/datafusion:vortex-file-compressed 🚀 21531527 24394574 0.88
tpcds_q20/datafusion:vortex-file-compressed 21960117 23797453 0.92
tpcds_q21/datafusion:vortex-file-compressed 35809442 38995310 0.92
tpcds_q22/datafusion:vortex-file-compressed 🚀 140988999 167426266 0.84
tpcds_q23/datafusion:vortex-file-compressed 🚀 149940063 170465945 0.88
tpcds_q24/datafusion:vortex-file-compressed 🚀 83319642 94368193 0.88
tpcds_q25/datafusion:vortex-file-compressed 65468850 68701939 0.95
tpcds_q26/datafusion:vortex-file-compressed 🚀 33710957 37490996 0.90
tpcds_q27/datafusion:vortex-file-compressed 113509856 111744556 1.02
tpcds_q28/datafusion:vortex-file-compressed 32865354 34334281 0.96
tpcds_q29/datafusion:vortex-file-compressed 62282958 67889038 0.92
tpcds_q30/datafusion:vortex-file-compressed 23328344 25364832 0.92
tpcds_q31/datafusion:vortex-file-compressed 73368853 75283329 0.97
tpcds_q32/datafusion:vortex-file-compressed 19590943 21165305 0.93
tpcds_q33/datafusion:vortex-file-compressed 29403310 31682229 0.93
tpcds_q34/datafusion:vortex-file-compressed 24237100 25560844 0.95
tpcds_q35/datafusion:vortex-file-compressed 44423026 46506498 0.96
tpcds_q36/datafusion:vortex-file-compressed 57862380 59821785 0.97
tpcds_q37/datafusion:vortex-file-compressed 23324697 25146268 0.93
tpcds_q38/datafusion:vortex-file-compressed 42436995 45780400 0.93
tpcds_q39/datafusion:vortex-file-compressed 105764716 109914781 0.96
tpcds_q40/datafusion:vortex-file-compressed 33218282 33176412 1.00
tpcds_q41/datafusion:vortex-file-compressed 15630814 16587901 0.94
tpcds_q42/datafusion:vortex-file-compressed 14346391 15100422 0.95
tpcds_q43/datafusion:vortex-file-compressed 18663907 19268388 0.97
tpcds_q44/datafusion:vortex-file-compressed 32122913 31731390 1.01
tpcds_q45/datafusion:vortex-file-compressed 28550724 28728490 0.99
tpcds_q46/datafusion:vortex-file-compressed 34475521 35832765 0.96
tpcds_q47/datafusion:vortex-file-compressed 131040294 137562005 0.95
tpcds_q48/datafusion:vortex-file-compressed 35915097 37276352 0.96
tpcds_q49/datafusion:vortex-file-compressed 57718547 58690332 0.98
tpcds_q50/datafusion:vortex-file-compressed 39519969 41443528 0.95
tpcds_q51/datafusion:vortex-file-compressed 88317493 89859763 0.98
tpcds_q52/datafusion:vortex-file-compressed 14447663 15026342 0.96
tpcds_q53/datafusion:vortex-file-compressed 21126453 22311043 0.95
tpcds_q54/datafusion:vortex-file-compressed 37303460 36285625 1.03
tpcds_q55/datafusion:vortex-file-compressed 14037317 15246603 0.92
tpcds_q56/datafusion:vortex-file-compressed 29778678 32528392 0.92
tpcds_q57/datafusion:vortex-file-compressed 105868765 107302486 0.99
tpcds_q58/datafusion:vortex-file-compressed 54448230 54089615 1.01
tpcds_q59/datafusion:vortex-file-compressed 56066461 57953533 0.97
tpcds_q60/datafusion:vortex-file-compressed 29275694 30697447 0.95
tpcds_q61/datafusion:vortex-file-compressed 40466931 41461008 0.98
tpcds_q62/datafusion:vortex-file-compressed 🚀 21502767 27794231 0.77
tpcds_q63/datafusion:vortex-file-compressed 22290314 22285573 1.00
tpcds_q64/datafusion:vortex-file-compressed 413623577 420824764 0.98
tpcds_q65/datafusion:vortex-file-compressed 39503930 40180538 0.98
tpcds_q66/datafusion:vortex-file-compressed 72491488 74961393 0.97
tpcds_q67/datafusion:vortex-file-compressed 149514572 147684908 1.01
tpcds_q68/datafusion:vortex-file-compressed 33096218 34252180 0.97
tpcds_q69/datafusion:vortex-file-compressed 35654836 37608473 0.95
tpcds_q70/datafusion:vortex-file-compressed 86580215 88348965 0.98
tpcds_q71/datafusion:vortex-file-compressed 23004983 23323460 0.99
tpcds_q72/datafusion:vortex-file-compressed 2184743520 2263460877 0.97
tpcds_q73/datafusion:vortex-file-compressed 22961888 24131745 0.95
tpcds_q74/datafusion:vortex-file-compressed 77868613 84706172 0.92
tpcds_q75/datafusion:vortex-file-compressed 108764512 112849249 0.96
tpcds_q76/datafusion:vortex-file-compressed 31562354 33034469 0.96
tpcds_q77/datafusion:vortex-file-compressed 39594710 42598618 0.93
tpcds_q78/datafusion:vortex-file-compressed 125174704 132060675 0.95
tpcds_q79/datafusion:vortex-file-compressed 28240175 29754264 0.95
tpcds_q80/datafusion:vortex-file-compressed 95458326 96360548 0.99
tpcds_q81/datafusion:vortex-file-compressed 24644754 25003022 0.99
tpcds_q82/datafusion:vortex-file-compressed 25289592 26330970 0.96
tpcds_q83/datafusion:vortex-file-compressed 33958199 37446383 0.91
tpcds_q84/datafusion:vortex-file-compressed 12942142 13672737 0.95
tpcds_q85/datafusion:vortex-file-compressed 95149147 94838153 1.00
tpcds_q86/datafusion:vortex-file-compressed 15648738 16942851 0.92
tpcds_q87/datafusion:vortex-file-compressed 🚀 43174559 48720789 0.89
tpcds_q88/datafusion:vortex-file-compressed 55900902 59168042 0.94
tpcds_q89/datafusion:vortex-file-compressed 24790795 25600933 0.97
tpcds_q90/datafusion:vortex-file-compressed 14716798 15351124 0.96
tpcds_q91/datafusion:vortex-file-compressed 19133437 19518809 0.98
tpcds_q92/datafusion:vortex-file-compressed 18170392 19436808 0.93
tpcds_q93/datafusion:vortex-file-compressed 35534641 33822967 1.05
tpcds_q94/datafusion:vortex-file-compressed 23457617 24059488 0.97
tpcds_q95/datafusion:vortex-file-compressed 60754175 62741591 0.97
tpcds_q96/datafusion:vortex-file-compressed 13525765 13895272 0.97
tpcds_q97/datafusion:vortex-file-compressed 34570838 32496800 1.06
tpcds_q98/datafusion:vortex-file-compressed 26220753 24633992 1.06
tpcds_q99/datafusion:vortex-file-compressed 29508289 29445470 1.00
datafusion / vortex-compact (0.972x ➖, 5↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 28051507 26539396 1.06
tpcds_q02/datafusion:vortex-compact 53556707 54500439 0.98
tpcds_q03/datafusion:vortex-compact 19817004 19797791 1.00
tpcds_q04/datafusion:vortex-compact 301891329 310487240 0.97
tpcds_q05/datafusion:vortex-compact 47266570 48958002 0.97
tpcds_q06/datafusion:vortex-compact 61068994 62921523 0.97
tpcds_q07/datafusion:vortex-compact 55156409 53792128 1.03
tpcds_q08/datafusion:vortex-compact 35829079 36506174 0.98
tpcds_q09/datafusion:vortex-compact 53045711 52303242 1.01
tpcds_q10/datafusion:vortex-compact 49088261 49990163 0.98
tpcds_q11/datafusion:vortex-compact 153075742 158309595 0.97
tpcds_q12/datafusion:vortex-compact 26097772 24923929 1.05
tpcds_q13/datafusion:vortex-compact 🚀 124684412 166195719 0.75
tpcds_q14/datafusion:vortex-compact 199306095 202875259 0.98
tpcds_q15/datafusion:vortex-compact 31217447 31267173 1.00
tpcds_q16/datafusion:vortex-compact 31342071 33779429 0.93
tpcds_q17/datafusion:vortex-compact 74588811 77528888 0.96
tpcds_q18/datafusion:vortex-compact 77578782 79307737 0.98
tpcds_q19/datafusion:vortex-compact 29251980 29818599 0.98
tpcds_q20/datafusion:vortex-compact 25714208 27786309 0.93
tpcds_q21/datafusion:vortex-compact 40237722 40967037 0.98
tpcds_q22/datafusion:vortex-compact 128947872 138652319 0.93
tpcds_q23/datafusion:vortex-compact 169264309 169711744 1.00
tpcds_q24/datafusion:vortex-compact 96944690 103084913 0.94
tpcds_q25/datafusion:vortex-compact 77850714 80932602 0.96
tpcds_q26/datafusion:vortex-compact 42714151 45851523 0.93
tpcds_q27/datafusion:vortex-compact 131770627 126393793 1.04
tpcds_q28/datafusion:vortex-compact 🚀 96017076 108023133 0.89
tpcds_q29/datafusion:vortex-compact 74208092 75382840 0.98
tpcds_q30/datafusion:vortex-compact 27241173 29500421 0.92
tpcds_q31/datafusion:vortex-compact 94756936 102429870 0.93
tpcds_q32/datafusion:vortex-compact 24865522 26113311 0.95
tpcds_q33/datafusion:vortex-compact 36990840 37079502 1.00
tpcds_q34/datafusion:vortex-compact 33177913 35175353 0.94
tpcds_q35/datafusion:vortex-compact 51025295 53917462 0.95
tpcds_q36/datafusion:vortex-compact 75384728 79827336 0.94
tpcds_q37/datafusion:vortex-compact 33359467 34815743 0.96
tpcds_q38/datafusion:vortex-compact 49018180 52644654 0.93
tpcds_q39/datafusion:vortex-compact 112965157 121937002 0.93
tpcds_q40/datafusion:vortex-compact 36615375 36927618 0.99
tpcds_q41/datafusion:vortex-compact 17472285 18434761 0.95
tpcds_q42/datafusion:vortex-compact 18437208 18802054 0.98
tpcds_q43/datafusion:vortex-compact 24834657 25253894 0.98
tpcds_q44/datafusion:vortex-compact 47065544 50325110 0.94
tpcds_q45/datafusion:vortex-compact 34107427 33037992 1.03
tpcds_q46/datafusion:vortex-compact 44868318 46472296 0.97
tpcds_q47/datafusion:vortex-compact 153781698 154718411 0.99
tpcds_q48/datafusion:vortex-compact 81216312 84640066 0.96
tpcds_q49/datafusion:vortex-compact 70953491 74118552 0.96
tpcds_q50/datafusion:vortex-compact 51730790 49277457 1.05
tpcds_q51/datafusion:vortex-compact 98912913 102746749 0.96
tpcds_q52/datafusion:vortex-compact 🚀 18463675 22561619 0.82
tpcds_q53/datafusion:vortex-compact 30141797 29640496 1.02
tpcds_q54/datafusion:vortex-compact 45676276 42718843 1.07
tpcds_q55/datafusion:vortex-compact 18022234 18662846 0.97
tpcds_q56/datafusion:vortex-compact 37867462 36191137 1.05
tpcds_q57/datafusion:vortex-compact 113399442 116894661 0.97
tpcds_q58/datafusion:vortex-compact 59601337 63601799 0.94
tpcds_q59/datafusion:vortex-compact 68235206 69982710 0.98
tpcds_q60/datafusion:vortex-compact 35771489 36468282 0.98
tpcds_q61/datafusion:vortex-compact 54448578 55818881 0.98
tpcds_q62/datafusion:vortex-compact 🚀 24017483 28470082 0.84
tpcds_q63/datafusion:vortex-compact 28205822 29082978 0.97
tpcds_q64/datafusion:vortex-compact 456544805 464687624 0.98
tpcds_q65/datafusion:vortex-compact 58029575 54267234 1.07
tpcds_q66/datafusion:vortex-compact 78488155 75340000 1.04
tpcds_q67/datafusion:vortex-compact 161668903 154663953 1.05
tpcds_q68/datafusion:vortex-compact 44137659 45969511 0.96
tpcds_q69/datafusion:vortex-compact 47196518 48218101 0.98
tpcds_q70/datafusion:vortex-compact 93490816 99634339 0.94
tpcds_q71/datafusion:vortex-compact 29800752 30804771 0.97
tpcds_q72/datafusion:vortex-compact 2194239801 2233197611 0.98
tpcds_q73/datafusion:vortex-compact 30633732 30906616 0.99
tpcds_q74/datafusion:vortex-compact 91105116 93082215 0.98
tpcds_q75/datafusion:vortex-compact 125660152 132118563 0.95
tpcds_q76/datafusion:vortex-compact 31984059 32053009 1.00
tpcds_q77/datafusion:vortex-compact 50721703 50699997 1.00
tpcds_q78/datafusion:vortex-compact 138253021 140424287 0.98
tpcds_q79/datafusion:vortex-compact 38362632 38337032 1.00
tpcds_q80/datafusion:vortex-compact 109042463 107008464 1.02
tpcds_q81/datafusion:vortex-compact 27357463 27768822 0.99
tpcds_q82/datafusion:vortex-compact 33955680 34406954 0.99
tpcds_q83/datafusion:vortex-compact 33654536 34303432 0.98
tpcds_q84/datafusion:vortex-compact 14652039 14582957 1.00
tpcds_q85/datafusion:vortex-compact 157419054 162415100 0.97
tpcds_q86/datafusion:vortex-compact 18116636 18729428 0.97
tpcds_q87/datafusion:vortex-compact 51337247 53987025 0.95
tpcds_q88/datafusion:vortex-compact 76787849 77964479 0.98
tpcds_q89/datafusion:vortex-compact 31724785 31051127 1.02
tpcds_q90/datafusion:vortex-compact 15015987 14998031 1.00
tpcds_q91/datafusion:vortex-compact 33405936 31887671 1.05
tpcds_q92/datafusion:vortex-compact 24380340 25215899 0.97
tpcds_q93/datafusion:vortex-compact 38838979 42852676 0.91
tpcds_q94/datafusion:vortex-compact 29173156 29727145 0.98
tpcds_q95/datafusion:vortex-compact 64756993 67780332 0.96
tpcds_q96/datafusion:vortex-compact 17417237 17761595 0.98
tpcds_q97/datafusion:vortex-compact 37501212 37071768 1.01
tpcds_q98/datafusion:vortex-compact 29955693 30259646 0.99
tpcds_q99/datafusion:vortex-compact 🚀 30217449 35618210 0.85
datafusion / parquet (0.951x ➖, 24↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚀 29138677 33601861 0.87
tpcds_q02/datafusion:parquet 41224614 45522796 0.91
tpcds_q03/datafusion:parquet 13443458 13863228 0.97
tpcds_q04/datafusion:parquet 🚀 258319217 312279690 0.83
tpcds_q05/datafusion:parquet 🚀 40157401 44985979 0.89
tpcds_q06/datafusion:parquet 58856017 60379037 0.97
tpcds_q07/datafusion:parquet 78528894 76697738 1.02
tpcds_q08/datafusion:parquet 26807122 26686223 1.00
tpcds_q09/datafusion:parquet 46472222 43735925 1.06
tpcds_q10/datafusion:parquet 69220468 68482843 1.01
tpcds_q11/datafusion:parquet 152458503 150541341 1.01
tpcds_q12/datafusion:parquet 18009403 16597379 1.09
tpcds_q13/datafusion:parquet 74432724 76648598 0.97
tpcds_q14/datafusion:parquet 160503668 165989193 0.97
tpcds_q15/datafusion:parquet 20582963 22221433 0.93
tpcds_q16/datafusion:parquet 25576872 25429271 1.01
tpcds_q17/datafusion:parquet 62019784 67455435 0.92
tpcds_q18/datafusion:parquet 113064534 115356994 0.98
tpcds_q19/datafusion:parquet 22297940 23089590 0.97
tpcds_q20/datafusion:parquet 17038224 16227190 1.05
tpcds_q21/datafusion:parquet 🚀 18072427 20365698 0.89
tpcds_q22/datafusion:parquet 146275711 141555289 1.03
tpcds_q23/datafusion:parquet 146038679 145402573 1.00
tpcds_q24/datafusion:parquet 90190996 89617736 1.01
tpcds_q25/datafusion:parquet 62568554 64027842 0.98
tpcds_q26/datafusion:parquet 63903009 65391878 0.98
tpcds_q27/datafusion:parquet 144961861 144958633 1.00
tpcds_q28/datafusion:parquet 45939307 43681382 1.05
tpcds_q29/datafusion:parquet 66832637 66074263 1.01
tpcds_q30/datafusion:parquet 34381381 36694890 0.94
tpcds_q31/datafusion:parquet 63832776 65192666 0.98
tpcds_q32/datafusion:parquet 18098847 19014063 0.95
tpcds_q33/datafusion:parquet 26412549 27608088 0.96
tpcds_q34/datafusion:parquet 23762972 22178712 1.07
tpcds_q35/datafusion:parquet 68965660 70354941 0.98
tpcds_q36/datafusion:parquet 58952706 56795202 1.04
tpcds_q37/datafusion:parquet 18612953 18643354 1.00
tpcds_q38/datafusion:parquet 40821736 44181477 0.92
tpcds_q39/datafusion:parquet 74086296 75440422 0.98
tpcds_q40/datafusion:parquet 23397349 23564891 0.99
tpcds_q41/datafusion:parquet 13357000 12999061 1.03
tpcds_q42/datafusion:parquet 11284128 11306630 1.00
tpcds_q43/datafusion:parquet 17083528 16773893 1.02
tpcds_q44/datafusion:parquet 33741731 33245169 1.01
tpcds_q45/datafusion:parquet 29661966 28389710 1.04
tpcds_q46/datafusion:parquet 31905810 33021662 0.97
tpcds_q47/datafusion:parquet 125066933 127331385 0.98
tpcds_q48/datafusion:parquet 68381880 68103068 1.00
tpcds_q49/datafusion:parquet 56010353 56484042 0.99
tpcds_q50/datafusion:parquet 43090882 44566139 0.97
tpcds_q51/datafusion:parquet 89027677 85936186 1.04
tpcds_q52/datafusion:parquet 12086106 11765450 1.03
tpcds_q53/datafusion:parquet 17644688 19074105 0.93
tpcds_q54/datafusion:parquet 33852728 35012989 0.97
tpcds_q55/datafusion:parquet 11188104 11160331 1.00
tpcds_q56/datafusion:parquet 27370800 26934804 1.02
tpcds_q57/datafusion:parquet 96339571 99990957 0.96
tpcds_q58/datafusion:parquet 50281686 50998201 0.99
tpcds_q59/datafusion:parquet 56153749 57759863 0.97
tpcds_q60/datafusion:parquet 27897048 27768343 1.00
tpcds_q61/datafusion:parquet 42557965 42923915 0.99
tpcds_q62/datafusion:parquet 19531067 21017080 0.93
tpcds_q63/datafusion:parquet 17576558 17644859 1.00
tpcds_q64/datafusion:parquet 517586248 517033306 1.00
tpcds_q65/datafusion:parquet 37946436 37095919 1.02
tpcds_q66/datafusion:parquet 🚀 65366789 73602008 0.89
tpcds_q67/datafusion:parquet 142435543 154079892 0.92
tpcds_q68/datafusion:parquet 31128317 33314368 0.93
tpcds_q69/datafusion:parquet 63437094 67118096 0.95
tpcds_q70/datafusion:parquet 92548550 87664225 1.06
tpcds_q71/datafusion:parquet 22028300 22283834 0.99
tpcds_q72/datafusion:parquet 🚀 606131519 682357629 0.89
tpcds_q73/datafusion:parquet 🚀 19995498 22437722 0.89
tpcds_q74/datafusion:parquet 🚀 80235962 96144233 0.83
tpcds_q75/datafusion:parquet 98630986 109405045 0.90
tpcds_q76/datafusion:parquet 🚀 29918760 34398600 0.87
tpcds_q77/datafusion:parquet 38864730 42964991 0.90
tpcds_q78/datafusion:parquet 115181598 126019963 0.91
tpcds_q79/datafusion:parquet 🚀 25421430 30450910 0.83
tpcds_q80/datafusion:parquet 🚀 80016663 94081611 0.85
tpcds_q81/datafusion:parquet 32450246 35656957 0.91
tpcds_q82/datafusion:parquet 🚀 19007184 21740623 0.87
tpcds_q83/datafusion:parquet 🚀 37189416 41792000 0.89
tpcds_q84/datafusion:parquet 🚀 38046408 43468313 0.88
tpcds_q85/datafusion:parquet 150392685 160721381 0.94
tpcds_q86/datafusion:parquet 16094487 17476250 0.92
tpcds_q87/datafusion:parquet 43140433 45260129 0.95
tpcds_q88/datafusion:parquet 🚀 58069892 65525151 0.89
tpcds_q89/datafusion:parquet 21246569 22887249 0.93
tpcds_q90/datafusion:parquet 🚀 14120764 18105264 0.78
tpcds_q91/datafusion:parquet 🚀 56890308 66676969 0.85
tpcds_q92/datafusion:parquet 🚀 17396120 21432527 0.81
tpcds_q93/datafusion:parquet 🚀 32031351 37315395 0.86
tpcds_q94/datafusion:parquet 🚀 19303041 22090322 0.87
tpcds_q95/datafusion:parquet 🚀 59261711 66197815 0.90
tpcds_q96/datafusion:parquet 🚀 11646882 13753854 0.85
tpcds_q97/datafusion:parquet 🚀 28571822 33241258 0.86
tpcds_q98/datafusion:parquet 21774037 23625683 0.92
tpcds_q99/datafusion:parquet 🚀 25243160 29378257 0.86
duckdb / vortex-file-compressed (0.967x ➖, 5↑ 1↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24273818 25603508 0.95
tpcds_q02/duckdb:vortex-file-compressed 🚀 27374311 36762851 0.74
tpcds_q03/duckdb:vortex-file-compressed 22269375 22980833 0.97
tpcds_q04/duckdb:vortex-file-compressed 92816341 93174029 1.00
tpcds_q05/duckdb:vortex-file-compressed 33313314 35521177 0.94
tpcds_q06/duckdb:vortex-file-compressed 32256825 33698789 0.96
tpcds_q07/duckdb:vortex-file-compressed 21029936 21780464 0.97
tpcds_q08/duckdb:vortex-file-compressed 26296443 27040788 0.97
tpcds_q09/duckdb:vortex-file-compressed 16485278 16276074 1.01
tpcds_q10/duckdb:vortex-file-compressed 36928527 38385750 0.96
tpcds_q11/duckdb:vortex-file-compressed 64824647 64887257 1.00
tpcds_q12/duckdb:vortex-file-compressed 15490250 16646942 0.93
tpcds_q13/duckdb:vortex-file-compressed 34173548 32596308 1.05
tpcds_q14/duckdb:vortex-file-compressed 96239574 97591895 0.99
tpcds_q15/duckdb:vortex-file-compressed 26489199 28814175 0.92
tpcds_q16/duckdb:vortex-file-compressed 27761403 28124126 0.99
tpcds_q17/duckdb:vortex-file-compressed 43474132 44860892 0.97
tpcds_q18/duckdb:vortex-file-compressed 37916546 37405628 1.01
tpcds_q19/duckdb:vortex-file-compressed 31810910 34369249 0.93
tpcds_q20/duckdb:vortex-file-compressed 17321811 17376560 1.00
tpcds_q21/duckdb:vortex-file-compressed 15789317 17540158 0.90
tpcds_q22/duckdb:vortex-file-compressed 73478404 79251650 0.93
tpcds_q23/duckdb:vortex-file-compressed 97691395 96900022 1.01
tpcds_q24/duckdb:vortex-file-compressed 47652892 47645355 1.00
tpcds_q25/duckdb:vortex-file-compressed 41553367 42665659 0.97
tpcds_q26/duckdb:vortex-file-compressed 🚨 21666517 19158918 1.13
tpcds_q27/duckdb:vortex-file-compressed 24226044 23577550 1.03
tpcds_q28/duckdb:vortex-file-compressed 12268189 12558815 0.98
tpcds_q29/duckdb:vortex-file-compressed 40580517 40081768 1.01
tpcds_q30/duckdb:vortex-file-compressed 25586864 26187288 0.98
tpcds_q31/duckdb:vortex-file-compressed 28716369 29145391 0.99
tpcds_q32/duckdb:vortex-file-compressed 13100967 13757221 0.95
tpcds_q33/duckdb:vortex-file-compressed 23322124 23937718 0.97
tpcds_q34/duckdb:vortex-file-compressed 24899466 24512963 1.02
tpcds_q35/duckdb:vortex-file-compressed 64513250 69938591 0.92
tpcds_q36/duckdb:vortex-file-compressed 24776043 25022827 0.99
tpcds_q37/duckdb:vortex-file-compressed 19385222 20139512 0.96
tpcds_q38/duckdb:vortex-file-compressed 37095637 36379255 1.02
tpcds_q39/duckdb:vortex-file-compressed 35854092 38618295 0.93
tpcds_q40/duckdb:vortex-file-compressed 20315873 20369594 1.00
tpcds_q41/duckdb:vortex-file-compressed 10123100 10505320 0.96
tpcds_q42/duckdb:vortex-file-compressed 13684244 13436049 1.02
tpcds_q43/duckdb:vortex-file-compressed 🚀 17502525 22285501 0.79
tpcds_q44/duckdb:vortex-file-compressed 21494523 23579596 0.91
tpcds_q45/duckdb:vortex-file-compressed 29496924 31279806 0.94
tpcds_q46/duckdb:vortex-file-compressed 31064142 32858401 0.95
tpcds_q47/duckdb:vortex-file-compressed 51458288 53335598 0.96
tpcds_q48/duckdb:vortex-file-compressed 28464223 30485380 0.93
tpcds_q49/duckdb:vortex-file-compressed 32731800 34453922 0.95
tpcds_q50/duckdb:vortex-file-compressed 26795975 25050399 1.07
tpcds_q51/duckdb:vortex-file-compressed 104391104 108799459 0.96
tpcds_q52/duckdb:vortex-file-compressed 13358995 13229914 1.01
tpcds_q53/duckdb:vortex-file-compressed 22695785 22781481 1.00
tpcds_q54/duckdb:vortex-file-compressed 27727561 29343512 0.94
tpcds_q55/duckdb:vortex-file-compressed 🚀 12588099 14033346 0.90
tpcds_q56/duckdb:vortex-file-compressed 25149656 26527963 0.95
tpcds_q57/duckdb:vortex-file-compressed 41895216 42562407 0.98
tpcds_q58/duckdb:vortex-file-compressed 29346489 30235155 0.97
tpcds_q59/duckdb:vortex-file-compressed 56549702 56893282 0.99
tpcds_q60/duckdb:vortex-file-compressed 25126173 25508526 0.99
tpcds_q61/duckdb:vortex-file-compressed 30603138 31301456 0.98
tpcds_q62/duckdb:vortex-file-compressed 16517291 16299901 1.01
tpcds_q63/duckdb:vortex-file-compressed 20251078 20598619 0.98
tpcds_q64/duckdb:vortex-file-compressed 92428146 95928683 0.96
tpcds_q65/duckdb:vortex-file-compressed 22822201 21990980 1.04
tpcds_q66/duckdb:vortex-file-compressed 29428910 31100325 0.95
tpcds_q67/duckdb:vortex-file-compressed 151018004 145974717 1.03
tpcds_q68/duckdb:vortex-file-compressed 29436438 32108763 0.92
tpcds_q69/duckdb:vortex-file-compressed 39544841 40830842 0.97
tpcds_q70/duckdb:vortex-file-compressed 35691879 36263140 0.98
tpcds_q71/duckdb:vortex-file-compressed 21121123 20211538 1.05
tpcds_q72/duckdb:vortex-file-compressed 168505578 178141892 0.95
tpcds_q73/duckdb:vortex-file-compressed 25616410 26374955 0.97
tpcds_q74/duckdb:vortex-file-compressed 41770227 42818742 0.98
tpcds_q75/duckdb:vortex-file-compressed 🚀 47358219 52998142 0.89
tpcds_q76/duckdb:vortex-file-compressed 21123847 20498725 1.03
tpcds_q77/duckdb:vortex-file-compressed 🚀 24442672 27848407 0.88
tpcds_q78/duckdb:vortex-file-compressed 74847661 82507980 0.91
tpcds_q79/duckdb:vortex-file-compressed 24557241 24124943 1.02
tpcds_q80/duckdb:vortex-file-compressed 45900473 50000025 0.92
tpcds_q81/duckdb:vortex-file-compressed 29304995 29948295 0.98
tpcds_q82/duckdb:vortex-file-compressed 45632757 45636337 1.00
tpcds_q83/duckdb:vortex-file-compressed 27001489 27349664 0.99
tpcds_q84/duckdb:vortex-file-compressed 17167659 18240590 0.94
tpcds_q85/duckdb:vortex-file-compressed 39807934 42781434 0.93
tpcds_q86/duckdb:vortex-file-compressed 16891940 17733924 0.95
tpcds_q87/duckdb:vortex-file-compressed 42296741 42629260 0.99
tpcds_q88/duckdb:vortex-file-compressed 51390942 51236217 1.00
tpcds_q89/duckdb:vortex-file-compressed 21289854 22197205 0.96
tpcds_q90/duckdb:vortex-file-compressed 10350472 10503802 0.99
tpcds_q91/duckdb:vortex-file-compressed 21304977 21972947 0.97
tpcds_q92/duckdb:vortex-file-compressed 19407514 19980153 0.97
tpcds_q93/duckdb:vortex-file-compressed 30053583 31749766 0.95
tpcds_q94/duckdb:vortex-file-compressed 21088320 22232602 0.95
tpcds_q95/duckdb:vortex-file-compressed 152897265 149347041 1.02
tpcds_q96/duckdb:vortex-file-compressed 12189498 13076351 0.93
tpcds_q97/duckdb:vortex-file-compressed 37642033 39069409 0.96
tpcds_q98/duckdb:vortex-file-compressed 19283770 19785336 0.97
tpcds_q99/duckdb:vortex-file-compressed 22788177 24555407 0.93
duckdb / vortex-compact (0.967x ➖, 5↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 27104168 27488236 0.99
tpcds_q02/duckdb:vortex-compact 36553143 40199194 0.91
tpcds_q03/duckdb:vortex-compact 48398664 51497711 0.94
tpcds_q04/duckdb:vortex-compact 99353635 106451055 0.93
tpcds_q05/duckdb:vortex-compact 42499097 43169001 0.98
tpcds_q06/duckdb:vortex-compact 39925866 40296968 0.99
tpcds_q07/duckdb:vortex-compact 34509935 35254955 0.98
tpcds_q08/duckdb:vortex-compact 39616546 40264818 0.98
tpcds_q09/duckdb:vortex-compact 18881798 20028527 0.94
tpcds_q10/duckdb:vortex-compact 52666256 54302812 0.97
tpcds_q11/duckdb:vortex-compact 75015813 75074625 1.00
tpcds_q12/duckdb:vortex-compact 22028804 23196883 0.95
tpcds_q13/duckdb:vortex-compact 53351118 53707988 0.99
tpcds_q14/duckdb:vortex-compact 115081291 121997949 0.94
tpcds_q15/duckdb:vortex-compact 29789871 30341411 0.98
tpcds_q16/duckdb:vortex-compact 28457707 27762844 1.03
tpcds_q17/duckdb:vortex-compact 56126584 54850922 1.02
tpcds_q18/duckdb:vortex-compact 48962470 50992438 0.96
tpcds_q19/duckdb:vortex-compact 44564104 45149777 0.99
tpcds_q20/duckdb:vortex-compact 20949337 21755930 0.96
tpcds_q21/duckdb:vortex-compact 🚀 17963116 20355223 0.88
tpcds_q22/duckdb:vortex-compact 80399359 79160988 1.02
tpcds_q23/duckdb:vortex-compact 105912510 113048413 0.94
tpcds_q24/duckdb:vortex-compact 58237501 59196793 0.98
tpcds_q25/duckdb:vortex-compact 52564780 54268828 0.97
tpcds_q26/duckdb:vortex-compact 32471920 34216503 0.95
tpcds_q27/duckdb:vortex-compact 37815861 36628938 1.03
tpcds_q28/duckdb:vortex-compact 33613154 34807256 0.97
tpcds_q29/duckdb:vortex-compact 51538959 54832072 0.94
tpcds_q30/duckdb:vortex-compact 🚀 28251604 31844910 0.89
tpcds_q31/duckdb:vortex-compact 34858488 34918510 1.00
tpcds_q32/duckdb:vortex-compact 20462700 21855136 0.94
tpcds_q33/duckdb:vortex-compact 31634703 34648266 0.91
tpcds_q34/duckdb:vortex-compact 29765440 31196514 0.95
tpcds_q35/duckdb:vortex-compact 74782768 76043028 0.98
tpcds_q36/duckdb:vortex-compact 35669871 37407777 0.95
tpcds_q37/duckdb:vortex-compact 22895864 24184573 0.95
tpcds_q38/duckdb:vortex-compact 40653457 42777578 0.95
tpcds_q39/duckdb:vortex-compact 37991696 38312532 0.99
tpcds_q40/duckdb:vortex-compact 24517299 25494491 0.96
tpcds_q41/duckdb:vortex-compact 11837824 12022984 0.98
tpcds_q42/duckdb:vortex-compact 18453811 20087981 0.92
tpcds_q43/duckdb:vortex-compact 🚀 29293905 33086005 0.89
tpcds_q44/duckdb:vortex-compact 30031122 29608656 1.01
tpcds_q45/duckdb:vortex-compact 🚀 35554900 40103280 0.89
tpcds_q46/duckdb:vortex-compact 44457075 46097119 0.96
tpcds_q47/duckdb:vortex-compact 62689975 67618610 0.93
tpcds_q48/duckdb:vortex-compact 44849765 47884830 0.94
tpcds_q49/duckdb:vortex-compact 49067379 50175075 0.98
tpcds_q50/duckdb:vortex-compact 37868004 38292275 0.99
tpcds_q51/duckdb:vortex-compact 122075280 115559229 1.06
tpcds_q52/duckdb:vortex-compact 19541621 19259920 1.01
tpcds_q53/duckdb:vortex-compact 32697652 33142930 0.99
tpcds_q54/duckdb:vortex-compact 36232391 37336706 0.97
tpcds_q55/duckdb:vortex-compact 18262291 18858264 0.97
tpcds_q56/duckdb:vortex-compact 33289793 32923825 1.01
tpcds_q57/duckdb:vortex-compact 45700561 46705958 0.98
tpcds_q58/duckdb:vortex-compact 37982868 40086508 0.95
tpcds_q59/duckdb:vortex-compact 66528905 67311892 0.99
tpcds_q60/duckdb:vortex-compact 35995798 37420507 0.96
tpcds_q61/duckdb:vortex-compact 53167606 55303955 0.96
tpcds_q62/duckdb:vortex-compact 21030624 21949083 0.96
tpcds_q63/duckdb:vortex-compact 31123659 31170490 1.00
tpcds_q64/duckdb:vortex-compact 126663942 130323822 0.97
tpcds_q65/duckdb:vortex-compact 30743421 31169530 0.99
tpcds_q66/duckdb:vortex-compact 36793928 36975066 1.00
tpcds_q67/duckdb:vortex-compact 148170513 154511008 0.96
tpcds_q68/duckdb:vortex-compact 44116574 48326057 0.91
tpcds_q69/duckdb:vortex-compact 54547063 56310470 0.97
tpcds_q70/duckdb:vortex-compact 58483258 59813352 0.98
tpcds_q71/duckdb:vortex-compact 29201652 29395861 0.99
tpcds_q72/duckdb:vortex-compact 181908686 190486525 0.95
tpcds_q73/duckdb:vortex-compact 28154837 28952407 0.97
tpcds_q74/duckdb:vortex-compact 49133895 48181116 1.02
tpcds_q75/duckdb:vortex-compact 59910062 62095322 0.96
tpcds_q76/duckdb:vortex-compact 🚀 27985734 33842245 0.83
tpcds_q77/duckdb:vortex-compact 37706632 37589750 1.00
tpcds_q78/duckdb:vortex-compact 86929920 87757297 0.99
tpcds_q79/duckdb:vortex-compact 40463906 40891293 0.99
tpcds_q80/duckdb:vortex-compact 69725970 71071625 0.98
tpcds_q81/duckdb:vortex-compact 33416355 34619554 0.97
tpcds_q82/duckdb:vortex-compact 49674371 49884586 1.00
tpcds_q83/duckdb:vortex-compact 35101161 35888093 0.98
tpcds_q84/duckdb:vortex-compact 21462936 21776908 0.99
tpcds_q85/duckdb:vortex-compact 54564410 54969816 0.99
tpcds_q86/duckdb:vortex-compact 20244848 20652913 0.98
tpcds_q87/duckdb:vortex-compact 44406946 47759266 0.93
tpcds_q88/duckdb:vortex-compact 75880333 77191971 0.98
tpcds_q89/duckdb:vortex-compact 32254474 33471902 0.96
tpcds_q90/duckdb:vortex-compact 10873761 11524120 0.94
tpcds_q91/duckdb:vortex-compact 40583184 43403267 0.94
tpcds_q92/duckdb:vortex-compact 40366984 40446037 1.00
tpcds_q93/duckdb:vortex-compact 32024531 33180647 0.97
tpcds_q94/duckdb:vortex-compact 28910735 29892518 0.97
tpcds_q95/duckdb:vortex-compact 165197676 167206483 0.99
tpcds_q96/duckdb:vortex-compact 15936527 17368191 0.92
tpcds_q97/duckdb:vortex-compact 42081995 42389338 0.99
tpcds_q98/duckdb:vortex-compact 26695190 27585366 0.97
tpcds_q99/duckdb:vortex-compact 26464737 27515389 0.96
duckdb / parquet (0.994x ➖, 0↑ 3↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28977662 29224212 0.99
tpcds_q02/duckdb:parquet 23909603 23963244 1.00
tpcds_q03/duckdb:parquet 12786837 13229749 0.97
tpcds_q04/duckdb:parquet 170980651 168129944 1.02
tpcds_q05/duckdb:parquet 33066919 32204171 1.03
tpcds_q06/duckdb:parquet 32503631 34281107 0.95
tpcds_q07/duckdb:parquet 24194523 24610086 0.98
tpcds_q08/duckdb:parquet 29036594 29840553 0.97
tpcds_q09/duckdb:parquet 44655234 44415393 1.01
tpcds_q10/duckdb:parquet 37929967 37346051 1.02
tpcds_q11/duckdb:parquet 94464732 89997753 1.05
tpcds_q12/duckdb:parquet 17146138 17174317 1.00
tpcds_q13/duckdb:parquet 34962782 35355868 0.99
tpcds_q14/duckdb:parquet 103006452 102983317 1.00
tpcds_q15/duckdb:parquet 30965578 31306338 0.99
tpcds_q16/duckdb:parquet 🚨 26888403 22892166 1.17
tpcds_q17/duckdb:parquet 38355725 39996678 0.96
tpcds_q18/duckdb:parquet 48958781 49014966 1.00
tpcds_q19/duckdb:parquet 32258664 31766558 1.02
tpcds_q20/duckdb:parquet 18619451 18924420 0.98
tpcds_q21/duckdb:parquet 12649297 12232394 1.03
tpcds_q22/duckdb:parquet 71312383 69294238 1.03
tpcds_q23/duckdb:parquet 83502463 80314039 1.04
tpcds_q24/duckdb:parquet 46442423 46856305 0.99
tpcds_q25/duckdb:parquet 35906989 35941319 1.00
tpcds_q26/duckdb:parquet 39659702 40285262 0.98
tpcds_q27/duckdb:parquet 53549081 53340453 1.00
tpcds_q28/duckdb:parquet 43302215 43066399 1.01
tpcds_q29/duckdb:parquet 38301116 39425648 0.97
tpcds_q30/duckdb:parquet 37810330 37683137 1.00
tpcds_q31/duckdb:parquet 27912842 28821246 0.97
tpcds_q32/duckdb:parquet 12100230 12940605 0.94
tpcds_q33/duckdb:parquet 24394409 23583485 1.03
tpcds_q34/duckdb:parquet 22819782 22880696 1.00
tpcds_q35/duckdb:parquet 61561342 61677831 1.00
tpcds_q36/duckdb:parquet 22279248 22783633 0.98
tpcds_q37/duckdb:parquet 13946834 14798706 0.94
tpcds_q38/duckdb:parquet 36295194 36953963 0.98
tpcds_q39/duckdb:parquet 32551023 31579200 1.03
tpcds_q40/duckdb:parquet 19408769 19740754 0.98
tpcds_q41/duckdb:parquet 8818252 8887604 0.99
tpcds_q42/duckdb:parquet 12303035 12706708 0.97
tpcds_q43/duckdb:parquet 17051699 18797786 0.91
tpcds_q44/duckdb:parquet 25730531 26377671 0.98
tpcds_q45/duckdb:parquet 28324856 30324267 0.93
tpcds_q46/duckdb:parquet 47707843 47728230 1.00
tpcds_q47/duckdb:parquet 51105590 49425799 1.03
tpcds_q48/duckdb:parquet 32361986 32261813 1.00
tpcds_q49/duckdb:parquet 29266760 29752721 0.98
tpcds_q50/duckdb:parquet 26133094 26445597 0.99
tpcds_q51/duckdb:parquet 106782430 104607251 1.02
tpcds_q52/duckdb:parquet 12992073 13801069 0.94
tpcds_q53/duckdb:parquet 19125900 19097925 1.00
tpcds_q54/duckdb:parquet 28545810 29706288 0.96
tpcds_q55/duckdb:parquet 12760257 12872101 0.99
tpcds_q56/duckdb:parquet 23528642 23824080 0.99
tpcds_q57/duckdb:parquet 38285635 37610901 1.02
tpcds_q58/duckdb:parquet 25735599 26009440 0.99
tpcds_q59/duckdb:parquet 36341060 36254734 1.00
tpcds_q60/duckdb:parquet 25474170 25101319 1.01
tpcds_q61/duckdb:parquet 33011303 34409729 0.96
tpcds_q62/duckdb:parquet 12558775 12670427 0.99
tpcds_q63/duckdb:parquet 17590044 17686415 0.99
tpcds_q64/duckdb:parquet 79806329 81484276 0.98
tpcds_q65/duckdb:parquet 23233988 22865766 1.02
tpcds_q66/duckdb:parquet 🚨 33123583 29246348 1.13
tpcds_q67/duckdb:parquet 137919423 137635090 1.00
tpcds_q68/duckdb:parquet 42279179 39890836 1.06
tpcds_q69/duckdb:parquet 38563191 39819834 0.97
tpcds_q70/duckdb:parquet 22540921 23462172 0.96
tpcds_q71/duckdb:parquet 24014986 23341460 1.03
tpcds_q72/duckdb:parquet 174548916 166965756 1.05
tpcds_q73/duckdb:parquet 20690192 20174298 1.03
tpcds_q74/duckdb:parquet 129006468 130428661 0.99
tpcds_q75/duckdb:parquet 57278837 58473186 0.98
tpcds_q76/duckdb:parquet 22586070 22296103 1.01
tpcds_q77/duckdb:parquet 25416274 25921723 0.98
tpcds_q78/duckdb:parquet 77388911 80778530 0.96
tpcds_q79/duckdb:parquet 30659258 30828460 0.99
tpcds_q80/duckdb:parquet 43006571 43623317 0.99
tpcds_q81/duckdb:parquet 35094036 36163547 0.97
tpcds_q82/duckdb:parquet 16416977 17593534 0.93
tpcds_q83/duckdb:parquet 18531274 19006251 0.98
tpcds_q84/duckdb:parquet 20692331 20970310 0.99
tpcds_q85/duckdb:parquet 43077305 43461509 0.99
tpcds_q86/duckdb:parquet 13763348 14317099 0.96
tpcds_q87/duckdb:parquet 39105167 40319758 0.97
tpcds_q88/duckdb:parquet 53863988 53800654 1.00
tpcds_q89/duckdb:parquet 21485992 22036984 0.97
tpcds_q90/duckdb:parquet 8422490 8817336 0.96
tpcds_q91/duckdb:parquet 24434185 26390584 0.93
tpcds_q92/duckdb:parquet 13301104 13783805 0.96
tpcds_q93/duckdb:parquet 32003715 33579373 0.95
tpcds_q94/duckdb:parquet 18405408 18569697 0.99
tpcds_q95/duckdb:parquet 🚨 145556725 125105140 1.16
tpcds_q96/duckdb:parquet 11128608 10748587 1.04
tpcds_q97/duckdb:parquet 37691018 38082803 0.99
tpcds_q98/duckdb:parquet 24580548 24747881 0.99
tpcds_q99/duckdb:parquet 20177987 20574594 0.98
duckdb / duckdb (0.992x ➖, 3↑ 1↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 21203801 23000172 0.92
tpcds_q02/duckdb:duckdb 19130928 20004683 0.96
tpcds_q03/duckdb:duckdb 9985363 10646148 0.94
tpcds_q04/duckdb:duckdb 173213426 180007104 0.96
tpcds_q05/duckdb:duckdb 21310748 20754894 1.03
tpcds_q06/duckdb:duckdb 28007330 28720869 0.98
tpcds_q07/duckdb:duckdb 40030660 41431815 0.97
tpcds_q08/duckdb:duckdb 120300569 120651412 1.00
tpcds_q09/duckdb:duckdb 20614978 20574279 1.00
tpcds_q10/duckdb:duckdb 27716406 27982065 0.99
tpcds_q11/duckdb:duckdb 91758283 91868531 1.00
tpcds_q12/duckdb:duckdb 14315624 14449896 0.99
tpcds_q13/duckdb:duckdb 25927777 26475456 0.98
tpcds_q14/duckdb:duckdb 95746914 93473294 1.02
tpcds_q15/duckdb:duckdb 24950370 25704023 0.97
tpcds_q16/duckdb:duckdb 🚀 19095653 21496341 0.89
tpcds_q17/duckdb:duckdb 24234914 24725804 0.98
tpcds_q18/duckdb:duckdb 46705178 48542661 0.96
tpcds_q19/duckdb:duckdb 20207504 19279048 1.05
tpcds_q20/duckdb:duckdb 14261846 14352175 0.99
tpcds_q21/duckdb:duckdb 🚀 7494593 9114476 0.82
tpcds_q22/duckdb:duckdb 66393207 64864548 1.02
tpcds_q23/duckdb:duckdb 78522972 78746404 1.00
tpcds_q24/duckdb:duckdb 25846245 25726924 1.00
tpcds_q25/duckdb:duckdb 18308121 19511901 0.94
tpcds_q26/duckdb:duckdb 28528087 28656653 1.00
tpcds_q27/duckdb:duckdb 40791787 42171894 0.97
tpcds_q28/duckdb:duckdb 25870313 25155066 1.03
tpcds_q29/duckdb:duckdb 23296754 23476321 0.99
tpcds_q30/duckdb:duckdb 30922173 31408223 0.98
tpcds_q31/duckdb:duckdb 51435316 52215023 0.99
tpcds_q32/duckdb:duckdb 8144947 8384091 0.97
tpcds_q33/duckdb:duckdb 16533182 16466385 1.00
tpcds_q34/duckdb:duckdb 18668364 18355642 1.02
tpcds_q35/duckdb:duckdb 36708108 37642124 0.98
tpcds_q36/duckdb:duckdb 71522027 72395890 0.99
tpcds_q37/duckdb:duckdb 8586704 8868716 0.97
tpcds_q38/duckdb:duckdb 33396378 34332986 0.97
tpcds_q39/duckdb:duckdb 28351956 28167092 1.01
tpcds_q40/duckdb:duckdb 14436237 14890181 0.97
tpcds_q41/duckdb:duckdb 9389177 9444501 0.99
tpcds_q42/duckdb:duckdb 8725173 8565190 1.02
tpcds_q43/duckdb:duckdb 14298819 15282191 0.94
tpcds_q44/duckdb:duckdb 15974050 15728643 1.02
tpcds_q45/duckdb:duckdb 18587668 18762242 0.99
tpcds_q46/duckdb:duckdb 38873613 38429484 1.01
tpcds_q47/duckdb:duckdb 46329581 45853720 1.01
tpcds_q48/duckdb:duckdb 24978109 25772879 0.97
tpcds_q49/duckdb:duckdb 21428874 20309397 1.06
tpcds_q50/duckdb:duckdb 16147553 16010386 1.01
tpcds_q51/duckdb:duckdb 100525164 98978829 1.02
tpcds_q52/duckdb:duckdb 10936690 10626740 1.03
tpcds_q53/duckdb:duckdb 17690015 18339223 0.96
tpcds_q54/duckdb:duckdb 19179866 19711628 0.97
tpcds_q55/duckdb:duckdb 🚀 9272760 10381599 0.89
tpcds_q56/duckdb:duckdb 16413368 16297975 1.01
tpcds_q57/duckdb:duckdb 36232497 36495277 0.99
tpcds_q58/duckdb:duckdb 18549678 17076328 1.09
tpcds_q59/duckdb:duckdb 36454370 36874558 0.99
tpcds_q60/duckdb:duckdb 18522225 18738363 0.99
tpcds_q61/duckdb:duckdb 16741149 16441977 1.02
tpcds_q62/duckdb:duckdb 9918640 10000355 0.99
tpcds_q63/duckdb:duckdb 16341472 16341909 1.00
tpcds_q64/duckdb:duckdb 57829669 59660361 0.97
tpcds_q65/duckdb:duckdb 36483345 37113603 0.98
tpcds_q66/duckdb:duckdb 26131101 26709915 0.98
tpcds_q67/duckdb:duckdb 133633654 133728729 1.00
tpcds_q68/duckdb:duckdb 26182980 27545668 0.95
tpcds_q69/duckdb:duckdb 29572256 28093670 1.05
tpcds_q70/duckdb:duckdb 16354675 16678483 0.98
tpcds_q71/duckdb:duckdb 17311754 15906532 1.09
tpcds_q72/duckdb:duckdb 45154959 46176600 0.98
tpcds_q73/duckdb:duckdb 14105750 14034289 1.01
tpcds_q74/duckdb:duckdb 148381770 146394077 1.01
tpcds_q75/duckdb:duckdb 47124543 46348760 1.02
tpcds_q76/duckdb:duckdb 14783836 14866716 0.99
tpcds_q77/duckdb:duckdb 16228617 14994670 1.08
tpcds_q78/duckdb:duckdb 65891167 65694381 1.00
tpcds_q79/duckdb:duckdb 20122789 20199468 1.00
tpcds_q80/duckdb:duckdb 31416871 31018622 1.01
tpcds_q81/duckdb:duckdb 41063325 41316821 0.99
tpcds_q82/duckdb:duckdb 10611393 10236734 1.04
tpcds_q83/duckdb:duckdb 10651051 11324092 0.94
tpcds_q84/duckdb:duckdb 14369157 14976944 0.96
tpcds_q85/duckdb:duckdb 25738027 25844280 1.00
tpcds_q86/duckdb:duckdb 11990874 12057544 0.99
tpcds_q87/duckdb:duckdb 35462088 36041937 0.98
tpcds_q88/duckdb:duckdb 30787113 28724312 1.07
tpcds_q89/duckdb:duckdb 21944244 21554216 1.02
tpcds_q90/duckdb:duckdb 6095316 6292458 0.97
tpcds_q91/duckdb:duckdb 14939945 14189266 1.05
tpcds_q92/duckdb:duckdb 9803191 9884596 0.99
tpcds_q93/duckdb:duckdb 23811233 24063061 0.99
tpcds_q94/duckdb:duckdb 14464928 14938360 0.97
tpcds_q95/duckdb:duckdb 🚨 131232644 113522764 1.16
tpcds_q96/duckdb:duckdb 5719357 5966132 0.96
tpcds_q97/duckdb:duckdb 32292815 32687358 0.99
tpcds_q98/duckdb:duckdb 20724861 21048156 0.98
tpcds_q99/duckdb:duckdb 16504573 16927645 0.98
File Size Changes (6 files changed, +0.0% overall, 6↑ 0↓)
File Scale Format Base HEAD Change %
time_dim.vortex 1.0 vortex-file-compressed 376.04 KB 381.02 KB +4.98 KB +1.3%
item.vortex 1.0 vortex-file-compressed 1.66 MB 1.66 MB +3.25 KB +0.2%
customer_address.vortex 1.0 vortex-file-compressed 824.85 KB 826.16 KB +1.30 KB +0.2%
customer.vortex 1.0 vortex-file-compressed 4.26 MB 4.27 MB +2.95 KB +0.1%
catalog_page.vortex 1.0 vortex-file-compressed 571.47 KB 571.77 KB +304 B +0.1%
item.vortex 1.0 vortex-compact 994.25 KB 994.32 KB +80 B +0.0%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (+0.0%)
  • vortex-file-compressed: 271.84 MB → 271.85 MB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +5.7% -7.3% +14.0% +21.3% ➖ noise
1 datafusion:vortex-file-compressed -16.1% -7.3% -9.6% +19.1% ➖ noise
1 duckdb:duckdb -7.8% -7.3% -0.6% +19.5% ➖ noise
1 duckdb:vortex-compact -1.4% -7.3% +6.3% +19.1% ➖ noise
1 duckdb:vortex-file-compressed -5.2% -7.3% +2.2% +27.7% ➖ noise
2 datafusion:vortex-compact -1.7% -4.9% +3.4% +10.9% ➖ noise
2 datafusion:vortex-file-compressed -10.4% -4.9% -5.7% +10.9% ➖ noise
2 duckdb:duckdb -4.4% -4.9% +0.6% +10.9% ➖ noise
2 duckdb:vortex-compact -9.1% -4.9% -4.3% +21.9% ➖ noise
2 duckdb:vortex-file-compressed -25.5% -4.9% -21.7% +30.6% ➖ noise
3 datafusion:vortex-compact +0.1% -3.2% +3.4% +10.9% ➖ noise
3 datafusion:vortex-file-compressed -9.1% -3.2% -6.1% +25.4% ➖ noise
3 duckdb:duckdb -6.2% -3.2% -3.1% +10.9% ➖ noise
3 duckdb:vortex-compact -6.0% -3.2% -2.9% +10.9% ➖ noise
3 duckdb:vortex-file-compressed -3.1% -3.2% +0.1% +10.9% ➖ noise
4 datafusion:vortex-compact -2.8% -8.3% +6.0% +10.9% ➖ noise
4 datafusion:vortex-file-compressed -13.0% -8.3% -5.1% +10.9% ➖ noise
4 duckdb:duckdb -3.8% -8.3% +4.9% +10.9% ➖ noise
4 duckdb:vortex-compact -6.7% -8.3% +1.8% +16.4% ➖ noise
4 duckdb:vortex-file-compressed -0.4% -8.3% +8.6% +10.9% ➖ noise
5 datafusion:vortex-compact -3.5% -4.3% +0.8% +12.4% ➖ noise
5 datafusion:vortex-file-compressed -8.4% -4.3% -4.4% +10.9% ➖ noise
5 duckdb:duckdb +2.7% -4.3% +7.2% +15.1% ➖ noise
5 duckdb:vortex-compact -1.6% -4.3% +2.8% +15.8% ➖ noise
5 duckdb:vortex-file-compressed -6.2% -4.3% -2.0% +10.9% ➖ noise
6 datafusion:vortex-compact -2.9% -3.9% +1.0% +10.9% ➖ noise
6 datafusion:vortex-file-compressed -2.6% -3.9% +1.3% +13.1% ➖ noise
6 duckdb:duckdb -2.5% -3.9% +1.4% +10.9% ➖ noise
6 duckdb:vortex-compact -0.9% -3.9% +3.1% +17.0% ➖ noise
6 duckdb:vortex-file-compressed -4.3% -3.9% -0.4% +10.9% ➖ noise
7 datafusion:vortex-compact +2.5% +0.3% +2.2% +30.1% ➖ noise
7 datafusion:vortex-file-compressed -8.0% +0.3% -8.3% +10.9% ➖ noise
7 duckdb:duckdb -3.4% +0.3% -3.7% +10.9% ➖ noise
7 duckdb:vortex-compact -2.1% +0.3% -2.4% +10.9% ➖ noise
7 duckdb:vortex-file-compressed -3.4% +0.3% -3.8% +10.9% ➖ noise
8 datafusion:vortex-compact -1.9% -1.1% -0.7% +10.9% ➖ noise
8 datafusion:vortex-file-compressed -11.4% -1.1% -10.4% +10.9% ✅ faster
8 duckdb:duckdb -0.3% -1.1% +0.9% +10.9% ➖ noise
8 duckdb:vortex-compact -1.6% -1.1% -0.5% +10.9% ➖ noise
8 duckdb:vortex-file-compressed -2.8% -1.1% -1.6% +27.0% ➖ noise
9 datafusion:vortex-compact +1.4% +3.4% -1.9% +10.9% ➖ noise
9 datafusion:vortex-file-compressed -9.6% +3.4% -12.5% +10.9% ✅ faster
9 duckdb:duckdb +0.2% +3.4% -3.1% +10.9% ➖ noise
9 duckdb:vortex-compact -5.7% +3.4% -8.8% +20.7% ➖ noise
9 duckdb:vortex-file-compressed +1.3% +3.4% -2.0% +14.3% ➖ noise
10 datafusion:vortex-compact -1.8% +1.3% -3.1% +10.9% ➖ noise
10 datafusion:vortex-file-compressed -13.7% +1.3% -14.8% +10.9% ✅ faster
10 duckdb:duckdb -0.9% +1.3% -2.2% +10.9% ➖ noise
10 duckdb:vortex-compact -3.0% +1.3% -4.3% +10.9% ➖ noise
10 duckdb:vortex-file-compressed -3.8% +1.3% -5.0% +10.9% ➖ noise
11 datafusion:vortex-compact -3.3% +3.1% -6.2% +13.9% ➖ noise
11 datafusion:vortex-file-compressed -12.5% +3.1% -15.2% +10.9% ✅ faster
11 duckdb:duckdb -0.1% +3.1% -3.1% +13.2% ➖ noise
11 duckdb:vortex-compact -0.1% +3.1% -3.1% +10.9% ➖ noise
11 duckdb:vortex-file-compressed -0.1% +3.1% -3.1% +10.9% ➖ noise
12 datafusion:vortex-compact +4.7% +4.1% +0.6% +16.2% ➖ noise
12 datafusion:vortex-file-compressed -22.7% +4.1% -25.7% +13.2% ✅ faster
12 duckdb:duckdb -0.9% +4.1% -4.8% +10.9% ➖ noise
12 duckdb:vortex-compact -5.0% +4.1% -8.8% +15.4% ➖ noise
12 duckdb:vortex-file-compressed -6.9% +4.1% -10.6% +21.1% ➖ noise
13 datafusion:vortex-compact -25.0% -2.0% -23.4% +24.1% ✅ faster
13 datafusion:vortex-file-compressed -12.1% -2.0% -10.3% +10.9% ✅ faster
13 duckdb:duckdb -2.1% -2.0% -0.1% +10.9% ➖ noise
13 duckdb:vortex-compact -0.7% -2.0% +1.4% +10.9% ➖ noise
13 duckdb:vortex-file-compressed +4.8% -2.0% +7.0% +17.9% ➖ noise
14 datafusion:vortex-compact -1.8% -1.7% -0.1% +10.9% ➖ noise
14 datafusion:vortex-file-compressed -12.0% -1.7% -10.5% +10.9% ✅ faster
14 duckdb:duckdb +2.4% -1.7% +4.2% +10.9% ➖ noise
14 duckdb:vortex-compact -5.7% -1.7% -4.1% +10.9% ➖ noise
14 duckdb:vortex-file-compressed -1.4% -1.7% +0.3% +10.9% ➖ noise
15 datafusion:vortex-compact -0.2% -4.3% +4.3% +10.9% ➖ noise
15 datafusion:vortex-file-compressed -13.0% -4.3% -9.1% +10.9% ➖ noise
15 duckdb:duckdb -2.9% -4.3% +1.4% +10.9% ➖ noise
15 duckdb:vortex-compact -1.8% -4.3% +2.6% +21.9% ➖ noise
15 duckdb:vortex-file-compressed -8.1% -4.3% -4.0% +19.8% ➖ noise
16 datafusion:vortex-compact -7.2% +8.7% -14.6% +11.6% ✅ faster
16 datafusion:vortex-file-compressed -18.9% +8.7% -25.3% +21.2% ✅ faster
16 duckdb:duckdb -11.2% +8.7% -18.3% +11.9% ✅ faster
16 duckdb:vortex-compact +2.5% +8.7% -5.7% +10.9% ➖ noise
16 duckdb:vortex-file-compressed -1.3% +8.7% -9.2% +13.5% ➖ noise
17 datafusion:vortex-compact -3.8% -6.1% +2.5% +25.2% ➖ noise
17 datafusion:vortex-file-compressed -12.1% -6.1% -6.4% +13.7% ➖ noise
17 duckdb:duckdb -2.0% -6.1% +4.4% +11.5% ➖ noise
17 duckdb:vortex-compact +2.3% -6.1% +9.0% +10.9% ➖ noise
17 duckdb:vortex-file-compressed -3.1% -6.1% +3.2% +14.0% ➖ noise
18 datafusion:vortex-compact -2.2% -1.1% -1.1% +10.9% ➖ noise
18 datafusion:vortex-file-compressed -11.9% -1.1% -10.9% +10.9% ✅ faster
18 duckdb:duckdb -3.8% -1.1% -2.8% +10.9% ➖ noise
18 duckdb:vortex-compact -4.0% -1.1% -3.0% +10.9% ➖ noise
18 duckdb:vortex-file-compressed +1.4% -1.1% +2.4% +10.9% ➖ noise
19 datafusion:vortex-compact -1.9% -1.0% -0.9% +12.0% ➖ noise
19 datafusion:vortex-file-compressed -11.7% -1.0% -10.9% +10.9% ✅ faster
19 duckdb:duckdb +4.8% -1.0% +5.8% +10.9% ➖ noise
19 duckdb:vortex-compact -1.3% -1.0% -0.3% +10.9% ➖ noise
19 duckdb:vortex-file-compressed -7.4% -1.0% -6.5% +19.9% ➖ noise
20 datafusion:vortex-compact -7.5% +1.6% -9.0% +18.1% ➖ noise
20 datafusion:vortex-file-compressed -7.7% +1.6% -9.2% +31.3% ➖ noise
20 duckdb:duckdb -0.6% +1.6% -2.2% +10.9% ➖ noise
20 duckdb:vortex-compact -3.7% +1.6% -5.3% +10.9% ➖ noise
20 duckdb:vortex-file-compressed -0.3% +1.6% -1.9% +10.9% ➖ noise
21 datafusion:vortex-compact -1.8% -4.2% +2.5% +14.6% ➖ noise
21 datafusion:vortex-file-compressed -8.2% -4.2% -4.1% +14.5% ➖ noise
21 duckdb:duckdb -17.8% -4.2% -14.2% +16.6% ➖ noise
21 duckdb:vortex-compact -11.8% -4.2% -7.9% +25.3% ➖ noise
21 duckdb:vortex-file-compressed -10.0% -4.2% -6.0% +16.3% ➖ noise
22 datafusion:vortex-compact -7.0% +3.1% -9.8% +23.1% ➖ noise
22 datafusion:vortex-file-compressed -15.8% +3.1% -18.3% +29.8% ➖ noise
22 duckdb:duckdb +2.4% +3.1% -0.7% +10.9% ➖ noise
22 duckdb:vortex-compact +1.6% +3.1% -1.5% +10.9% ➖ noise
22 duckdb:vortex-file-compressed -7.3% +3.1% -10.1% +11.3% ➖ noise
23 datafusion:vortex-compact -0.3% +2.2% -2.4% +10.9% ➖ noise
23 datafusion:vortex-file-compressed -12.0% +2.2% -13.9% +10.9% ✅ faster
23 duckdb:duckdb -0.3% +2.2% -2.4% +10.9% ➖ noise
23 duckdb:vortex-compact -6.3% +2.2% -8.3% +10.9% ➖ noise
23 duckdb:vortex-file-compressed +0.8% +2.2% -1.3% +10.9% ➖ noise
24 datafusion:vortex-compact -6.0% -0.1% -5.8% +18.5% ➖ noise
24 datafusion:vortex-file-compressed -11.7% -0.1% -11.6% +13.0% ✅ faster
24 duckdb:duckdb +0.5% -0.1% +0.6% +10.9% ➖ noise
24 duckdb:vortex-compact -1.6% -0.1% -1.5% +11.6% ➖ noise
24 duckdb:vortex-file-compressed +0.0% -0.1% +0.1% +10.9% ➖ noise
25 datafusion:vortex-compact -3.8% -1.2% -2.6% +10.9% ➖ noise
25 datafusion:vortex-file-compressed -4.7% -1.2% -3.6% +16.4% ➖ noise
25 duckdb:duckdb -6.2% -1.2% -5.0% +10.9% ➖ noise
25 duckdb:vortex-compact -3.1% -1.2% -2.0% +10.9% ➖ noise
25 duckdb:vortex-file-compressed -2.6% -1.2% -1.4% +18.6% ➖ noise
26 datafusion:vortex-compact -6.8% -1.9% -5.0% +10.9% ➖ noise
26 datafusion:vortex-file-compressed -10.1% -1.9% -8.3% +10.9% ➖ noise
26 duckdb:duckdb -0.4% -1.9% +1.5% +10.9% ➖ noise
26 duckdb:vortex-compact -5.1% -1.9% -3.2% +10.9% ➖ noise
26 duckdb:vortex-file-compressed +13.1% -1.9% +15.3% +14.8% 🚨 regression
27 datafusion:vortex-compact +4.3% +0.2% +4.0% +14.1% ➖ noise
27 datafusion:vortex-file-compressed +1.6% +0.2% +1.4% +11.6% ➖ noise
27 duckdb:duckdb -3.3% +0.2% -3.5% +10.9% ➖ noise
27 duckdb:vortex-compact +3.2% +0.2% +3.0% +16.2% ➖ noise
27 duckdb:vortex-file-compressed +2.8% +0.2% +2.5% +10.9% ➖ noise
28 datafusion:vortex-compact -11.1% +2.8% -13.6% +11.5% ✅ faster
28 datafusion:vortex-file-compressed -4.3% +2.8% -6.9% +19.9% ➖ noise
28 duckdb:duckdb +2.8% +2.8% +0.0% +10.9% ➖ noise
28 duckdb:vortex-compact -3.4% +2.8% -6.1% +10.9% ➖ noise
28 duckdb:vortex-file-compressed -2.3% +2.8% -5.0% +10.9% ➖ noise
29 datafusion:vortex-compact -1.6% -0.9% -0.7% +14.7% ➖ noise
29 datafusion:vortex-file-compressed -8.3% -0.9% -7.5% +14.7% ➖ noise
29 duckdb:duckdb -0.8% -0.9% +0.1% +13.6% ➖ noise
29 duckdb:vortex-compact -6.0% -0.9% -5.2% +13.9% ➖ noise
29 duckdb:vortex-file-compressed +1.2% -0.9% +2.1% +16.0% ➖ noise
30 datafusion:vortex-compact -7.7% -3.0% -4.8% +10.9% ➖ noise
30 datafusion:vortex-file-compressed -8.0% -3.0% -5.1% +12.4% ➖ noise
30 duckdb:duckdb -1.5% -3.0% +1.5% +10.9% ➖ noise
30 duckdb:vortex-compact -11.3% -3.0% -8.5% +10.9% ➖ noise
30 duckdb:vortex-file-compressed -2.3% -3.0% +0.8% +10.9% ➖ noise
31 datafusion:vortex-compact -7.5% -2.6% -5.0% +15.3% ➖ noise
31 datafusion:vortex-file-compressed -2.5% -2.6% +0.1% +11.6% ➖ noise
31 duckdb:duckdb -1.5% -2.6% +1.2% +10.9% ➖ noise
31 duckdb:vortex-compact -0.2% -2.6% +2.5% +20.3% ➖ noise
31 duckdb:vortex-file-compressed -1.5% -2.6% +1.2% +14.5% ➖ noise
32 datafusion:vortex-compact -4.8% -5.7% +0.9% +10.9% ➖ noise
32 datafusion:vortex-file-compressed -7.4% -5.7% -1.9% +10.9% ➖ noise
32 duckdb:duckdb -2.9% -5.7% +3.0% +10.9% ➖ noise
32 duckdb:vortex-compact -6.4% -5.7% -0.8% +10.9% ➖ noise
32 duckdb:vortex-file-compressed -4.8% -5.7% +0.9% +10.9% ➖ noise
33 datafusion:vortex-compact -0.2% -0.5% +0.3% +10.9% ➖ noise
33 datafusion:vortex-file-compressed -7.2% -0.5% -6.7% +10.9% ➖ noise
33 duckdb:duckdb +0.4% -0.5% +0.9% +10.9% ➖ noise
33 duckdb:vortex-compact -8.7% -0.5% -8.2% +19.6% ➖ noise
33 duckdb:vortex-file-compressed -2.6% -0.5% -2.1% +10.9% ➖ noise
34 datafusion:vortex-compact -5.7% +3.4% -8.8% +10.9% ➖ noise
34 datafusion:vortex-file-compressed -5.2% +3.4% -8.3% +12.4% ➖ noise
34 duckdb:duckdb +1.7% +3.4% -1.6% +10.9% ➖ noise
34 duckdb:vortex-compact -4.6% +3.4% -7.7% +10.9% ➖ noise
34 duckdb:vortex-file-compressed +1.6% +3.4% -1.7% +10.9% ➖ noise
35 datafusion:vortex-compact -5.4% -1.1% -4.3% +11.5% ➖ noise
35 datafusion:vortex-file-compressed -4.5% -1.1% -3.4% +10.9% ➖ noise
35 duckdb:duckdb -2.5% -1.1% -1.4% +10.9% ➖ noise
35 duckdb:vortex-compact -1.7% -1.1% -0.6% +10.9% ➖ noise
35 duckdb:vortex-file-compressed -7.8% -1.1% -6.7% +13.2% ➖ noise
36 datafusion:vortex-compact -5.6% +0.7% -6.3% +16.7% ➖ noise
36 datafusion:vortex-file-compressed -3.3% +0.7% -4.0% +13.8% ➖ noise
36 duckdb:duckdb -1.2% +0.7% -1.9% +10.9% ➖ noise
36 duckdb:vortex-compact -4.6% +0.7% -5.4% +11.8% ➖ noise
36 duckdb:vortex-file-compressed -1.0% +0.7% -1.7% +10.9% ➖ noise
37 datafusion:vortex-compact -4.2% -3.0% -1.2% +10.9% ➖ noise
37 datafusion:vortex-file-compressed -7.2% -3.0% -4.4% +18.6% ➖ noise
37 duckdb:duckdb -3.2% -3.0% -0.2% +10.9% ➖ noise
37 duckdb:vortex-compact -5.3% -3.0% -2.4% +10.9% ➖ noise
37 duckdb:vortex-file-compressed -3.7% -3.0% -0.8% +10.9% ➖ noise
38 datafusion:vortex-compact -6.9% -4.7% -2.3% +10.9% ➖ noise
38 datafusion:vortex-file-compressed -7.3% -4.7% -2.7% +10.9% ➖ noise
38 duckdb:duckdb -2.7% -4.7% +2.1% +13.5% ➖ noise
38 duckdb:vortex-compact -5.0% -4.7% -0.2% +10.9% ➖ noise
38 duckdb:vortex-file-compressed +2.0% -4.7% +7.0% +13.7% ➖ noise
39 datafusion:vortex-compact -7.4% +0.6% -7.9% +11.8% ➖ noise
39 datafusion:vortex-file-compressed -3.8% +0.6% -4.4% +11.6% ➖ noise
39 duckdb:duckdb +0.7% +0.6% +0.0% +19.6% ➖ noise
39 duckdb:vortex-compact -0.8% +0.6% -1.4% +18.9% ➖ noise
39 duckdb:vortex-file-compressed -7.2% +0.6% -7.7% +20.3% ➖ noise
40 datafusion:vortex-compact -0.8% -1.2% +0.4% +10.9% ➖ noise
40 datafusion:vortex-file-compressed +0.1% -1.2% +1.3% +17.5% ➖ noise
40 duckdb:duckdb -3.0% -1.2% -1.9% +10.9% ➖ noise
40 duckdb:vortex-compact -3.8% -1.2% -2.7% +10.9% ➖ noise
40 duckdb:vortex-file-compressed -0.3% -1.2% +0.9% +10.9% ➖ noise
41 datafusion:vortex-compact -5.2% +1.0% -6.1% +10.9% ➖ noise
41 datafusion:vortex-file-compressed -5.8% +1.0% -6.7% +10.9% ➖ noise
41 duckdb:duckdb -0.6% +1.0% -1.5% +10.9% ➖ noise
41 duckdb:vortex-compact -1.5% +1.0% -2.5% +10.9% ➖ noise
41 duckdb:vortex-file-compressed -3.6% +1.0% -4.6% +10.9% ➖ noise
42 datafusion:vortex-compact -1.9% -1.7% -0.2% +14.6% ➖ noise
42 datafusion:vortex-file-compressed -5.0% -1.7% -3.4% +13.4% ➖ noise
42 duckdb:duckdb +1.9% -1.7% +3.6% +21.0% ➖ noise
42 duckdb:vortex-compact -8.1% -1.7% -6.5% +13.2% ➖ noise
42 duckdb:vortex-file-compressed +1.8% -1.7% +3.6% +10.9% ➖ noise
43 datafusion:vortex-compact -1.7% -3.9% +2.3% +22.0% ➖ noise
43 datafusion:vortex-file-compressed -3.1% -3.9% +0.8% +10.9% ➖ noise
43 duckdb:duckdb -6.4% -3.9% -2.7% +10.9% ➖ noise
43 duckdb:vortex-compact -11.5% -3.9% -7.9% +32.2% ➖ noise
43 duckdb:vortex-file-compressed -21.5% -3.9% -18.3% +19.2% ✅ faster
44 datafusion:vortex-compact -6.5% -0.5% -6.0% +15.9% ➖ noise
44 datafusion:vortex-file-compressed +1.2% -0.5% +1.7% +20.3% ➖ noise
44 duckdb:duckdb +1.6% -0.5% +2.1% +10.9% ➖ noise
44 duckdb:vortex-compact +1.4% -0.5% +1.9% +10.9% ➖ noise
44 duckdb:vortex-file-compressed -8.8% -0.5% -8.4% +10.9% ➖ noise
45 datafusion:vortex-compact +3.2% -1.2% +4.5% +16.3% ➖ noise
45 datafusion:vortex-file-compressed -0.6% -1.2% +0.6% +10.9% ➖ noise
45 duckdb:duckdb -0.9% -1.2% +0.3% +10.9% ➖ noise
45 duckdb:vortex-compact -11.3% -1.2% -10.3% +10.9% ✅ faster
45 duckdb:vortex-file-compressed -5.7% -1.2% -4.5% +16.9% ➖ noise
46 datafusion:vortex-compact -3.5% -1.7% -1.8% +10.9% ➖ noise
46 datafusion:vortex-file-compressed -3.8% -1.7% -2.1% +10.9% ➖ noise
46 duckdb:duckdb +1.2% -1.7% +2.9% +10.9% ➖ noise
46 duckdb:vortex-compact -3.6% -1.7% -1.9% +11.1% ➖ noise
46 duckdb:vortex-file-compressed -5.5% -1.7% -3.8% +15.8% ➖ noise
47 datafusion:vortex-compact -0.6% +0.8% -1.4% +10.9% ➖ noise
47 datafusion:vortex-file-compressed -4.7% +0.8% -5.5% +10.9% ➖ noise
47 duckdb:duckdb +1.0% +0.8% +0.3% +10.9% ➖ noise
47 duckdb:vortex-compact -7.3% +0.8% -8.0% +10.9% ➖ noise
47 duckdb:vortex-file-compressed -3.5% +0.8% -4.3% +10.9% ➖ noise
48 datafusion:vortex-compact -4.0% +0.4% -4.4% +12.7% ➖ noise
48 datafusion:vortex-file-compressed -3.7% +0.4% -4.0% +10.9% ➖ noise
48 duckdb:duckdb -3.1% +0.4% -3.4% +10.9% ➖ noise
48 duckdb:vortex-compact -6.3% +0.4% -6.7% +10.9% ➖ noise
48 duckdb:vortex-file-compressed -6.6% +0.4% -7.0% +12.0% ➖ noise
49 datafusion:vortex-compact -4.3% -1.2% -3.1% +10.9% ➖ noise
49 datafusion:vortex-file-compressed -1.7% -1.2% -0.4% +10.9% ➖ noise
49 duckdb:duckdb +5.5% -1.2% +6.8% +11.7% ➖ noise
49 duckdb:vortex-compact -2.2% -1.2% -1.0% +20.6% ➖ noise
49 duckdb:vortex-file-compressed -5.0% -1.2% -3.8% +25.5% ➖ noise
50 datafusion:vortex-compact +5.0% -2.3% +7.4% +14.6% ➖ noise
50 datafusion:vortex-file-compressed -4.6% -2.3% -2.4% +15.4% ➖ noise
50 duckdb:duckdb +0.9% -2.3% +3.2% +10.9% ➖ noise
50 duckdb:vortex-compact -1.1% -2.3% +1.2% +10.9% ➖ noise
50 duckdb:vortex-file-compressed +7.0% -2.3% +9.4% +16.4% ➖ noise
51 datafusion:vortex-compact -3.7% +2.8% -6.4% +10.9% ➖ noise
51 datafusion:vortex-file-compressed -1.7% +2.8% -4.4% +10.9% ➖ noise
51 duckdb:duckdb +1.6% +2.8% -1.2% +10.9% ➖ noise
51 duckdb:vortex-compact +5.6% +2.8% +2.7% +13.6% ➖ noise
51 duckdb:vortex-file-compressed -4.1% +2.8% -6.7% +14.6% ➖ noise
52 datafusion:vortex-compact -18.2% -1.7% -16.8% +15.5% ✅ faster
52 datafusion:vortex-file-compressed -3.9% -1.7% -2.2% +13.2% ➖ noise
52 duckdb:duckdb +2.9% -1.7% +4.7% +24.0% ➖ noise
52 duckdb:vortex-compact +1.5% -1.7% +3.2% +11.8% ➖ noise
52 duckdb:vortex-file-compressed +1.0% -1.7% +2.7% +17.6% ➖ noise
53 datafusion:vortex-compact +1.7% -3.7% +5.7% +11.8% ➖ noise
53 datafusion:vortex-file-compressed -5.3% -3.7% -1.6% +10.9% ➖ noise
53 duckdb:duckdb -3.5% -3.7% +0.2% +10.9% ➖ noise
53 duckdb:vortex-compact -1.3% -3.7% +2.5% +10.9% ➖ noise
53 duckdb:vortex-file-compressed -0.4% -3.7% +3.5% +10.9% ➖ noise
54 datafusion:vortex-compact +6.9% -3.6% +10.9% +14.2% ➖ noise
54 datafusion:vortex-file-compressed +2.8% -3.6% +6.7% +18.0% ➖ noise
54 duckdb:duckdb -2.7% -3.6% +0.9% +10.9% ➖ noise
54 duckdb:vortex-compact -3.0% -3.6% +0.7% +10.9% ➖ noise
54 duckdb:vortex-file-compressed -5.5% -3.6% -2.0% +10.9% ➖ noise
55 datafusion:vortex-compact -3.4% -0.3% -3.1% +12.7% ➖ noise
55 datafusion:vortex-file-compressed -7.9% -0.3% -7.6% +14.2% ➖ noise
55 duckdb:duckdb -10.7% -0.3% -10.4% +16.5% ➖ noise
55 duckdb:vortex-compact -3.2% -0.3% -2.9% +10.9% ➖ noise
55 duckdb:vortex-file-compressed -10.3% -0.3% -10.0% +19.0% ➖ noise
56 datafusion:vortex-compact +4.6% +0.2% +4.4% +14.5% ➖ noise
56 datafusion:vortex-file-compressed -8.5% +0.2% -8.6% +15.6% ➖ noise
56 duckdb:duckdb +0.7% +0.2% +0.5% +10.9% ➖ noise
56 duckdb:vortex-compact +1.1% +0.2% +0.9% +25.9% ➖ noise
56 duckdb:vortex-file-compressed -5.2% +0.2% -5.4% +10.9% ➖ noise
57 datafusion:vortex-compact -3.0% -1.0% -2.0% +14.2% ➖ noise
57 datafusion:vortex-file-compressed -1.3% -1.0% -0.4% +10.9% ➖ noise
57 duckdb:duckdb -0.7% -1.0% +0.2% +10.9% ➖ noise
57 duckdb:vortex-compact -2.2% -1.0% -1.2% +12.9% ➖ noise
57 duckdb:vortex-file-compressed -1.6% -1.0% -0.6% +12.2% ➖ noise
58 datafusion:vortex-compact -6.3% -1.2% -5.1% +10.9% ➖ noise
58 datafusion:vortex-file-compressed +0.7% -1.2% +1.9% +10.9% ➖ noise
58 duckdb:duckdb +8.6% -1.2% +10.0% +10.9% ➖ noise
58 duckdb:vortex-compact -5.2% -1.2% -4.1% +11.3% ➖ noise
58 duckdb:vortex-file-compressed -2.9% -1.2% -1.7% +11.9% ➖ noise
59 datafusion:vortex-compact -2.5% -1.3% -1.2% +15.0% ➖ noise
59 datafusion:vortex-file-compressed -3.3% -1.3% -2.0% +10.9% ➖ noise
59 duckdb:duckdb -1.1% -1.3% +0.1% +10.9% ➖ noise
59 duckdb:vortex-compact -1.2% -1.3% +0.1% +25.5% ➖ noise
59 duckdb:vortex-file-compressed -0.6% -1.3% +0.7% +29.1% ➖ noise
60 datafusion:vortex-compact -1.9% +1.0% -2.9% +12.4% ➖ noise
60 datafusion:vortex-file-compressed -4.6% +1.0% -5.6% +10.9% ➖ noise
60 duckdb:duckdb -1.2% +1.0% -2.1% +10.9% ➖ noise
60 duckdb:vortex-compact -3.8% +1.0% -4.7% +20.9% ➖ noise
60 duckdb:vortex-file-compressed -1.5% +1.0% -2.4% +10.9% ➖ noise
61 datafusion:vortex-compact -2.5% -2.5% +0.0% +12.3% ➖ noise
61 datafusion:vortex-file-compressed -2.4% -2.5% +0.1% +10.9% ➖ noise
61 duckdb:duckdb +1.8% -2.5% +4.4% +10.9% ➖ noise
61 duckdb:vortex-compact -3.9% -2.5% -1.4% +10.9% ➖ noise
61 duckdb:vortex-file-compressed -2.2% -2.5% +0.2% +10.9% ➖ noise
62 datafusion:vortex-compact -15.6% -4.0% -12.1% +14.7% ➖ noise
62 datafusion:vortex-file-compressed -22.6% -4.0% -19.4% +41.5% ➖ noise
62 duckdb:duckdb -0.8% -4.0% +3.3% +10.9% ➖ noise
62 duckdb:vortex-compact -4.2% -4.0% -0.2% +23.1% ➖ noise
62 duckdb:vortex-file-compressed +1.3% -4.0% +5.6% +15.2% ➖ noise
63 datafusion:vortex-compact -3.0% -0.5% -2.6% +10.9% ➖ noise
63 datafusion:vortex-file-compressed +0.0% -0.5% +0.5% +10.9% ➖ noise
63 duckdb:duckdb -0.0% -0.5% +0.5% +10.9% ➖ noise
63 duckdb:vortex-compact -0.2% -0.5% +0.3% +12.8% ➖ noise
63 duckdb:vortex-file-compressed -1.7% -0.5% -1.2% +13.3% ➖ noise
64 datafusion:vortex-compact -1.8% -1.0% -0.8% +10.9% ➖ noise
64 datafusion:vortex-file-compressed -1.7% -1.0% -0.7% +10.9% ➖ noise
64 duckdb:duckdb -3.1% -1.0% -2.1% +10.9% ➖ noise
64 duckdb:vortex-compact -2.8% -1.0% -1.8% +11.0% ➖ noise
64 duckdb:vortex-file-compressed -3.6% -1.0% -2.7% +11.2% ➖ noise
65 datafusion:vortex-compact +6.9% +2.0% +4.9% +19.5% ➖ noise
65 datafusion:vortex-file-compressed -1.7% +2.0% -3.6% +18.3% ➖ noise
65 duckdb:duckdb -1.7% +2.0% -3.6% +10.9% ➖ noise
65 duckdb:vortex-compact -1.4% +2.0% -3.3% +21.8% ➖ noise
65 duckdb:vortex-file-compressed +3.8% +2.0% +1.8% +10.9% ➖ noise
66 datafusion:vortex-compact +4.2% +0.3% +3.9% +12.7% ➖ noise
66 datafusion:vortex-file-compressed -3.3% +0.3% -3.6% +11.2% ➖ noise
66 duckdb:duckdb -2.2% +0.3% -2.5% +10.9% ➖ noise
66 duckdb:vortex-compact -0.5% +0.3% -0.8% +24.0% ➖ noise
66 duckdb:vortex-file-compressed -5.4% +0.3% -5.6% +18.6% ➖ noise
67 datafusion:vortex-compact +4.5% -3.8% +8.6% +12.1% ➖ noise
67 datafusion:vortex-file-compressed +1.2% -3.8% +5.2% +10.9% ➖ noise
67 duckdb:duckdb -0.1% -3.8% +3.8% +10.9% ➖ noise
67 duckdb:vortex-compact -4.1% -3.8% -0.4% +10.9% ➖ noise
67 duckdb:vortex-file-compressed +3.5% -3.8% +7.5% +10.9% ➖ noise
68 datafusion:vortex-compact -4.0% -0.5% -3.5% +10.9% ➖ noise
68 datafusion:vortex-file-compressed -3.4% -0.5% -2.9% +10.9% ➖ noise
68 duckdb:duckdb -4.9% -0.5% -4.5% +10.9% ➖ noise
68 duckdb:vortex-compact -8.7% -0.5% -8.3% +10.9% ➖ noise
68 duckdb:vortex-file-compressed -8.3% -0.5% -7.9% +16.3% ➖ noise
69 datafusion:vortex-compact -2.1% -4.3% +2.3% +13.3% ➖ noise
69 datafusion:vortex-file-compressed -5.2% -4.3% -0.9% +15.9% ➖ noise
69 duckdb:duckdb +5.3% -4.3% +10.0% +10.9% ➖ noise
69 duckdb:vortex-compact -3.1% -4.3% +1.2% +10.9% ➖ noise
69 duckdb:vortex-file-compressed -3.1% -4.3% +1.2% +10.9% ➖ noise
70 datafusion:vortex-compact -6.2% +0.7% -6.8% +19.4% ➖ noise
70 datafusion:vortex-file-compressed -2.0% +0.7% -2.7% +20.1% ➖ noise
70 duckdb:duckdb -1.9% +0.7% -2.6% +10.9% ➖ noise
70 duckdb:vortex-compact -2.2% +0.7% -2.9% +13.1% ➖ noise
70 duckdb:vortex-file-compressed -1.6% +0.7% -2.3% +23.0% ➖ noise
71 datafusion:vortex-compact -3.3% +0.8% -4.1% +10.9% ➖ noise
71 datafusion:vortex-file-compressed -1.4% +0.8% -2.2% +10.9% ➖ noise
71 duckdb:duckdb +8.8% +0.8% +7.9% +11.7% ➖ noise
71 duckdb:vortex-compact -0.7% +0.8% -1.5% +11.7% ➖ noise
71 duckdb:vortex-file-compressed +4.5% +0.8% +3.6% +10.9% ➖ noise
72 datafusion:vortex-compact -1.7% -3.6% +2.0% +10.9% ➖ noise
72 datafusion:vortex-file-compressed -3.5% -3.6% +0.2% +10.9% ➖ noise
72 duckdb:duckdb -2.2% -3.6% +1.5% +10.9% ➖ noise
72 duckdb:vortex-compact -4.5% -3.6% -0.9% +10.9% ➖ noise
72 duckdb:vortex-file-compressed -5.4% -3.6% -1.8% +10.9% ➖ noise
73 datafusion:vortex-compact -0.9% -4.4% +3.7% +10.9% ➖ noise
73 datafusion:vortex-file-compressed -4.8% -4.4% -0.5% +33.2% ➖ noise
73 duckdb:duckdb +0.5% -4.4% +5.1% +10.9% ➖ noise
73 duckdb:vortex-compact -2.8% -4.4% +1.7% +10.9% ➖ noise
73 duckdb:vortex-file-compressed -2.9% -4.4% +1.6% +18.7% ➖ noise
74 datafusion:vortex-compact -2.1% -9.1% +7.7% +10.9% ➖ noise
74 datafusion:vortex-file-compressed -8.1% -9.1% +1.2% +10.9% ➖ noise
74 duckdb:duckdb +1.4% -9.1% +11.6% +10.9% 🚨 regression
74 duckdb:vortex-compact +2.0% -9.1% +12.2% +13.0% ➖ noise
74 duckdb:vortex-file-compressed -2.4% -9.1% +7.4% +10.9% ➖ noise
75 datafusion:vortex-compact -4.9% -6.0% +1.2% +18.6% ➖ noise
75 datafusion:vortex-file-compressed -3.6% -6.0% +2.6% +17.6% ➖ noise
75 duckdb:duckdb +1.7% -6.0% +8.2% +10.9% ➖ noise
75 duckdb:vortex-compact -3.5% -6.0% +2.7% +10.9% ➖ noise
75 duckdb:vortex-file-compressed -10.6% -6.0% -4.9% +22.8% ➖ noise
76 datafusion:vortex-compact -0.2% -6.1% +6.3% +10.9% ➖ noise
76 datafusion:vortex-file-compressed -4.5% -6.1% +1.8% +10.9% ➖ noise
76 duckdb:duckdb -0.6% -6.1% +5.9% +10.9% ➖ noise
76 duckdb:vortex-compact -17.3% -6.1% -11.9% +10.9% ✅ faster
76 duckdb:vortex-file-compressed +3.0% -6.1% +9.8% +10.9% ➖ noise
77 datafusion:vortex-compact +0.0% -5.8% +6.2% +21.6% ➖ noise
77 datafusion:vortex-file-compressed -7.1% -5.8% -1.3% +12.0% ➖ noise
77 duckdb:duckdb +8.2% -5.8% +14.9% +12.6% 🚨 regression
77 duckdb:vortex-compact +0.3% -5.8% +6.5% +19.5% ➖ noise
77 duckdb:vortex-file-compressed -12.2% -5.8% -6.8% +11.8% ➖ noise
78 datafusion:vortex-compact -1.5% -6.4% +5.2% +11.0% ➖ noise
78 datafusion:vortex-file-compressed -5.2% -6.4% +1.3% +14.2% ➖ noise
78 duckdb:duckdb +0.3% -6.4% +7.2% +10.9% ➖ noise
78 duckdb:vortex-compact -0.9% -6.4% +5.9% +10.9% ➖ noise
78 duckdb:vortex-file-compressed -9.3% -6.4% -3.1% +10.9% ➖ noise
79 datafusion:vortex-compact +0.1% -8.9% +9.8% +10.9% ➖ noise
79 datafusion:vortex-file-compressed -5.1% -8.9% +4.2% +10.9% ➖ noise
79 duckdb:duckdb -0.4% -8.9% +9.3% +14.8% ➖ noise
79 duckdb:vortex-compact -1.0% -8.9% +8.6% +10.9% ➖ noise
79 duckdb:vortex-file-compressed +1.8% -8.9% +11.7% +26.3% ➖ noise
80 datafusion:vortex-compact +1.9% -8.4% +11.3% +13.1% ➖ noise
80 datafusion:vortex-file-compressed -0.9% -8.4% +8.2% +16.8% ➖ noise
80 duckdb:duckdb +1.3% -8.4% +10.6% +10.9% ➖ noise
80 duckdb:vortex-compact -1.9% -8.4% +7.1% +10.9% ➖ noise
80 duckdb:vortex-file-compressed -8.2% -8.4% +0.3% +10.9% ➖ noise
81 datafusion:vortex-compact -1.5% -6.0% +4.8% +10.9% ➖ noise
81 datafusion:vortex-file-compressed -1.4% -6.0% +4.9% +21.5% ➖ noise
81 duckdb:duckdb -0.6% -6.0% +5.8% +11.9% ➖ noise
81 duckdb:vortex-compact -3.5% -6.0% +2.7% +10.9% ➖ noise
81 duckdb:vortex-file-compressed -2.1% -6.0% +4.1% +10.9% ➖ noise
82 datafusion:vortex-compact -1.3% -9.7% +9.3% +10.9% ➖ noise
82 datafusion:vortex-file-compressed -4.0% -9.7% +6.3% +10.9% ➖ noise
82 duckdb:duckdb +3.7% -9.7% +14.8% +13.5% 🚨 regression
82 duckdb:vortex-compact -0.4% -9.7% +10.2% +11.4% ➖ noise
82 duckdb:vortex-file-compressed -0.0% -9.7% +10.7% +10.9% ➖ noise
83 datafusion:vortex-compact -1.9% -6.9% +5.3% +21.8% ➖ noise
83 datafusion:vortex-file-compressed -9.3% -6.9% -2.6% +13.2% ➖ noise
83 duckdb:duckdb -5.9% -6.9% +1.0% +10.9% ➖ noise
83 duckdb:vortex-compact -2.2% -6.9% +5.0% +12.4% ➖ noise
83 duckdb:vortex-file-compressed -1.3% -6.9% +6.0% +14.2% ➖ noise
84 datafusion:vortex-compact +0.5% -7.1% +8.1% +13.3% ➖ noise
84 datafusion:vortex-file-compressed -5.3% -7.1% +1.9% +10.9% ➖ noise
84 duckdb:duckdb -4.1% -7.1% +3.2% +10.9% ➖ noise
84 duckdb:vortex-compact -1.4% -7.1% +6.1% +10.9% ➖ noise
84 duckdb:vortex-file-compressed -5.9% -7.1% +1.3% +10.9% ➖ noise
85 datafusion:vortex-compact -3.1% -3.7% +0.6% +16.1% ➖ noise
85 datafusion:vortex-file-compressed +0.3% -3.7% +4.2% +10.9% ➖ noise
85 duckdb:duckdb -0.4% -3.7% +3.4% +10.9% ➖ noise
85 duckdb:vortex-compact -0.7% -3.7% +3.1% +10.9% ➖ noise
85 duckdb:vortex-file-compressed -7.0% -3.7% -3.4% +10.9% ➖ noise
86 datafusion:vortex-compact -3.3% -5.9% +2.8% +19.2% ➖ noise
86 datafusion:vortex-file-compressed -7.6% -5.9% -1.8% +31.9% ➖ noise
86 duckdb:duckdb -0.6% -5.9% +5.7% +10.9% ➖ noise
86 duckdb:vortex-compact -2.0% -5.9% +4.2% +11.1% ➖ noise
86 duckdb:vortex-file-compressed -4.7% -5.9% +1.2% +17.3% ➖ noise
87 datafusion:vortex-compact -4.9% -3.9% -1.1% +21.1% ➖ noise
87 datafusion:vortex-file-compressed -11.4% -3.9% -7.8% +10.9% ➖ noise
87 duckdb:duckdb -1.6% -3.9% +2.3% +10.9% ➖ noise
87 duckdb:vortex-compact -7.0% -3.9% -3.3% +13.5% ➖ noise
87 duckdb:vortex-file-compressed -0.8% -3.9% +3.2% +20.4% ➖ noise
88 datafusion:vortex-compact -1.5% -5.8% +4.6% +10.9% ➖ noise
88 datafusion:vortex-file-compressed -5.5% -5.8% +0.3% +10.9% ➖ noise
88 duckdb:duckdb +7.2% -5.8% +13.8% +10.9% 🚨 regression
88 duckdb:vortex-compact -1.7% -5.8% +4.4% +10.9% ➖ noise
88 duckdb:vortex-file-compressed +0.3% -5.8% +6.5% +10.9% ➖ noise
89 datafusion:vortex-compact +2.2% -4.9% +7.4% +11.5% ➖ noise
89 datafusion:vortex-file-compressed -3.2% -4.9% +1.8% +10.9% ➖ noise
89 duckdb:duckdb +1.8% -4.9% +7.0% +10.9% ➖ noise
89 duckdb:vortex-compact -3.6% -4.9% +1.3% +23.8% ➖ noise
89 duckdb:vortex-file-compressed -4.1% -4.9% +0.8% +10.9% ➖ noise
90 datafusion:vortex-compact +0.1% -13.7% +16.0% +13.8% 🚨 regression
90 datafusion:vortex-file-compressed -4.1% -13.7% +11.1% +14.2% ➖ noise
90 duckdb:duckdb -3.1% -13.7% +12.2% +12.1% 🚨 regression
90 duckdb:vortex-compact -5.6% -13.7% +9.3% +47.9% ➖ noise
90 duckdb:vortex-file-compressed -1.5% -13.7% +14.2% +13.9% 🚨 regression
91 datafusion:vortex-compact +4.8% -11.1% +17.9% +13.2% 🚨 regression
91 datafusion:vortex-file-compressed -2.0% -11.1% +10.3% +23.8% ➖ noise
91 duckdb:duckdb +5.3% -11.1% +18.5% +10.9% 🚨 regression
91 duckdb:vortex-compact -6.5% -11.1% +5.2% +10.9% ➖ noise
91 duckdb:vortex-file-compressed -3.0% -11.1% +9.1% +10.9% ➖ noise
92 datafusion:vortex-compact -3.3% -11.5% +9.2% +11.7% ➖ noise
92 datafusion:vortex-file-compressed -6.5% -11.5% +5.6% +23.1% ➖ noise
92 duckdb:duckdb -0.8% -11.5% +12.1% +10.9% 🚨 regression
92 duckdb:vortex-compact -0.2% -11.5% +12.8% +15.8% ➖ noise
92 duckdb:vortex-file-compressed -2.9% -11.5% +9.8% +29.6% ➖ noise
93 datafusion:vortex-compact -9.4% -9.6% +0.2% +16.7% ➖ noise
93 datafusion:vortex-file-compressed +5.1% -9.6% +16.2% +10.9% 🚨 regression
93 duckdb:duckdb -1.0% -9.6% +9.4% +10.9% ➖ noise
93 duckdb:vortex-compact -3.5% -9.6% +6.7% +10.9% ➖ noise
93 duckdb:vortex-file-compressed -5.3% -9.6% +4.7% +10.9% ➖ noise
94 datafusion:vortex-compact -1.9% -6.9% +5.5% +16.2% ➖ noise
94 datafusion:vortex-file-compressed -2.5% -6.9% +4.8% +10.9% ➖ noise
94 duckdb:duckdb -3.2% -6.9% +4.0% +10.9% ➖ noise
94 duckdb:vortex-compact -3.3% -6.9% +3.9% +22.6% ➖ noise
94 duckdb:vortex-file-compressed -5.1% -6.9% +1.9% +10.9% ➖ noise
95 datafusion:vortex-compact -4.5% +2.1% -6.4% +15.9% ➖ noise
95 datafusion:vortex-file-compressed -3.2% +2.1% -5.1% +12.9% ➖ noise
95 duckdb:duckdb +15.6% +2.1% +13.3% +17.6% ➖ noise
95 duckdb:vortex-compact -1.2% +2.1% -3.2% +15.5% ➖ noise
95 duckdb:vortex-file-compressed +2.4% +2.1% +0.3% +17.8% ➖ noise
96 datafusion:vortex-compact -1.9% -6.4% +4.7% +10.9% ➖ noise
96 datafusion:vortex-file-compressed -2.7% -6.4% +4.0% +10.9% ➖ noise
96 duckdb:duckdb -4.1% -6.4% +2.4% +18.1% ➖ noise
96 duckdb:vortex-compact -8.2% -6.4% -2.0% +11.8% ➖ noise
96 duckdb:vortex-file-compressed -6.8% -6.4% -0.4% +10.9% ➖ noise
97 datafusion:vortex-compact +1.2% -7.8% +9.7% +20.2% ➖ noise
97 datafusion:vortex-file-compressed +6.4% -7.8% +15.3% +14.2% 🚨 regression
97 duckdb:duckdb -1.2% -7.8% +7.1% +10.9% ➖ noise
97 duckdb:vortex-compact -0.7% -7.8% +7.6% +10.9% ➖ noise
97 duckdb:vortex-file-compressed -3.7% -7.8% +4.5% +10.9% ➖ noise
98 datafusion:vortex-compact -1.0% -4.3% +3.5% +23.2% ➖ noise
98 datafusion:vortex-file-compressed +6.4% -4.3% +11.3% +16.3% ➖ noise
98 duckdb:duckdb -1.5% -4.3% +2.9% +10.9% ➖ noise
98 duckdb:vortex-compact -3.2% -4.3% +1.1% +10.9% ➖ noise
98 duckdb:vortex-file-compressed -2.5% -4.3% +1.9% +22.8% ➖ noise
99 datafusion:vortex-compact -15.2% -8.2% -7.6% +21.0% ➖ noise
99 datafusion:vortex-file-compressed +0.2% -8.2% +9.2% +17.0% ➖ noise
99 duckdb:duckdb -2.5% -8.2% +6.2% +12.0% ➖ noise
99 duckdb:vortex-compact -3.8% -8.2% +4.8% +24.9% ➖ noise
99 duckdb:vortex-file-compressed -7.2% -8.2% +1.1% +22.1% ➖ noise

@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.5%
Engines: DataFusion No clear signal (+5.2%, environment too noisy confidence) · DuckDB No clear signal (-2.0%, low confidence)
Vortex (geomean): 1.161x ➖
Parquet (geomean): 1.143x ➖
Shifts: Parquet (control) +14.3% · Median polish +13.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.169x ➖, 0↑ 2↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 34664122 37148326 0.93
fineweb_q01/datafusion:vortex-file-compressed 545811216 459513253 1.19
fineweb_q02/datafusion:vortex-file-compressed 🚨 627059957 462920684 1.35
fineweb_q03/datafusion:vortex-file-compressed 1107987268 1083353797 1.02
fineweb_q04/datafusion:vortex-file-compressed 1135804750 1137208846 1.00
fineweb_q05/datafusion:vortex-file-compressed 1075623045 1074657447 1.00
fineweb_q06/datafusion:vortex-file-compressed 🚨 2172784225 1185017837 1.83
fineweb_q07/datafusion:vortex-file-compressed 1385691669 1097478196 1.26
fineweb_q08/datafusion:vortex-file-compressed 512220062 446097186 1.15
datafusion / vortex-compact (1.347x ❌, 0↑ 3↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 56333189 27887744 2.02
fineweb_q01/datafusion:vortex-compact 🚨 885898335 454124513 1.95
fineweb_q02/datafusion:vortex-compact 🚨 1220531483 588156395 2.08
fineweb_q03/datafusion:vortex-compact 1473214630 1388387239 1.06
fineweb_q04/datafusion:vortex-compact 1763945158 1577195610 1.12
fineweb_q05/datafusion:vortex-compact 1519618141 1381049924 1.10
fineweb_q06/datafusion:vortex-compact 1670378116 1330805257 1.26
fineweb_q07/datafusion:vortex-compact 1341145218 1190060785 1.13
fineweb_q08/datafusion:vortex-compact 364191170 377943351 0.96
datafusion / parquet (1.193x ➖, 0↑ 1↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 1438298007 1029973049 1.40
fineweb_q01/datafusion:parquet 1974498156 1710987829 1.15
fineweb_q02/datafusion:parquet 2197101507 1773401901 1.24
fineweb_q03/datafusion:parquet 2104881790 1819060318 1.16
fineweb_q04/datafusion:parquet 2318417762 1848619998 1.25
fineweb_q05/datafusion:parquet 2168092296 1951058646 1.11
fineweb_q06/datafusion:parquet 2057701152 1873819837 1.10
fineweb_q07/datafusion:parquet 2053471040 1748880730 1.17
fineweb_q08/datafusion:parquet 2068095131 1753121908 1.18
duckdb / vortex-file-compressed (1.172x ➖, 0↑ 2↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 84859199 80865539 1.05
fineweb_q01/duckdb:vortex-file-compressed 657826312 529891896 1.24
fineweb_q02/duckdb:vortex-file-compressed 🚨 562791796 421087998 1.34
fineweb_q03/duckdb:vortex-file-compressed 1357318478 1314569739 1.03
fineweb_q04/duckdb:vortex-file-compressed 1435678997 1401758487 1.02
fineweb_q05/duckdb:vortex-file-compressed 1327499643 1202518527 1.10
fineweb_q06/duckdb:vortex-file-compressed 1766303305 1415145646 1.25
fineweb_q07/duckdb:vortex-file-compressed 1439234842 1223253789 1.18
fineweb_q08/duckdb:vortex-file-compressed 🚨 752764638 537516965 1.40
duckdb / vortex-compact (0.983x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 60496975 84221982 0.72
fineweb_q01/duckdb:vortex-compact 596486374 534947261 1.12
fineweb_q02/duckdb:vortex-compact 621795366 580829601 1.07
fineweb_q03/duckdb:vortex-compact 1623495144 1770376902 0.92
fineweb_q04/duckdb:vortex-compact 1773660796 1884290929 0.94
fineweb_q05/duckdb:vortex-compact 1625029767 1585216219 1.03
fineweb_q06/duckdb:vortex-compact 1682583751 1544456511 1.09
fineweb_q07/duckdb:vortex-compact 1395458938 1325749902 1.05
fineweb_q08/duckdb:vortex-compact 459364722 464867651 0.99
duckdb / parquet (1.096x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1329795140 1191478316 1.12
fineweb_q01/duckdb:parquet 1512362031 1347436709 1.12
fineweb_q02/duckdb:parquet 1499253852 1332976643 1.12
fineweb_q03/duckdb:parquet 4060064375 3540343737 1.15
fineweb_q04/duckdb:parquet 2185003438 2028257829 1.08
fineweb_q05/duckdb:parquet 2322648186 2150220434 1.08
fineweb_q06/duckdb:parquet 4708074924 4273123125 1.10
fineweb_q07/duckdb:parquet 2999263558 2673431091 1.12
fineweb_q08/duckdb:parquet 1176603962 1202296485 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +102.0% +24.8% +61.8% +195.3% ➖ noise
0 datafusion:vortex-file-compressed -6.7% +24.8% -25.3% +159.6% ➖ noise
0 duckdb:vortex-compact -28.2% +24.8% -42.5% +86.7% ➖ noise
0 duckdb:vortex-file-compressed +4.9% +24.8% -15.9% +79.9% ➖ noise
1 datafusion:vortex-compact +95.1% +13.8% +71.4% +82.9% ➖ noise
1 datafusion:vortex-file-compressed +18.8% +13.8% +4.4% +93.6% ➖ noise
1 duckdb:vortex-compact +11.5% +13.8% -2.0% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +24.1% +13.8% +9.1% +50.0% ➖ noise
2 datafusion:vortex-compact +107.5% +18.0% +75.8% +34.2% 🚨 regression
2 datafusion:vortex-file-compressed +35.5% +18.0% +14.8% +41.3% ➖ noise
2 duckdb:vortex-compact +7.1% +18.0% -9.3% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +33.7% +18.0% +13.2% +30.0% ➖ noise
3 datafusion:vortex-compact +6.1% +15.2% -7.9% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +2.3% +15.2% -11.2% +30.0% ➖ noise
3 duckdb:vortex-compact -8.3% +15.2% -20.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +3.3% +15.2% -10.4% +34.2% ➖ noise
4 datafusion:vortex-compact +11.8% +16.2% -3.8% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.1% +16.2% -14.1% +30.0% ➖ noise
4 duckdb:vortex-compact -5.9% +16.2% -19.0% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +2.4% +16.2% -11.9% +30.0% ➖ noise
5 datafusion:vortex-compact +10.0% +9.6% +0.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +0.1% +9.6% -8.6% +30.0% ➖ noise
5 duckdb:vortex-compact +2.5% +9.6% -6.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +10.4% +9.6% +0.8% +30.0% ➖ noise
6 datafusion:vortex-compact +25.5% +10.0% +14.1% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +83.4% +10.0% +66.7% +57.3% 🚨 regression
6 duckdb:vortex-compact +8.9% +10.0% -1.0% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +24.8% +10.0% +13.5% +30.0% ➖ noise
7 datafusion:vortex-compact +12.7% +14.8% -1.8% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +26.3% +14.8% +10.0% +30.0% ➖ noise
7 duckdb:vortex-compact +5.3% +14.8% -8.3% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +17.7% +14.8% +2.5% +30.0% ➖ noise
8 datafusion:vortex-compact -3.6% +7.4% -10.3% +32.3% ➖ noise
8 datafusion:vortex-file-compressed +14.8% +7.4% +6.9% +35.4% ➖ noise
8 duckdb:vortex-compact -1.2% +7.4% -8.0% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +40.0% +7.4% +30.3% +30.0% 🚨 regression

@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Engines: DuckDB No clear signal (+2.1%, low confidence)
Vortex (geomean): 1.002x ➖
Parquet (geomean): 0.981x ➖
Shifts: Parquet (control) -1.9% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
duckdb / vortex-file-compressed (1.005x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11758358 12380608 0.95
statpopgen_q01/duckdb:vortex-file-compressed 27285260 27448089 0.99
statpopgen_q02/duckdb:vortex-file-compressed 555218996 548104271 1.01
statpopgen_q03/duckdb:vortex-file-compressed 1085161370 1076919478 1.01
statpopgen_q04/duckdb:vortex-file-compressed 1105003791 1069577556 1.03
statpopgen_q05/duckdb:vortex-file-compressed 499336434 528705376 0.94
statpopgen_q06/duckdb:vortex-file-compressed 1578686886 1560869212 1.01
statpopgen_q07/duckdb:vortex-file-compressed 212778097 202563595 1.05
statpopgen_q08/duckdb:vortex-file-compressed 244414947 241904976 1.01
statpopgen_q09/duckdb:vortex-file-compressed 857967172 829756511 1.03
statpopgen_q10/duckdb:vortex-file-compressed 2619097988 2579998984 1.02
duckdb / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 12427787 12209329 1.02
statpopgen_q01/duckdb:vortex-compact 216530341 216015885 1.00
statpopgen_q02/duckdb:vortex-compact 565533003 571155309 0.99
statpopgen_q03/duckdb:vortex-compact 1169044540 1164946129 1.00
statpopgen_q04/duckdb:vortex-compact 1171160421 1178230928 0.99
statpopgen_q05/duckdb:vortex-compact 584475614 588039033 0.99
statpopgen_q06/duckdb:vortex-compact 1511004125 1508055799 1.00
statpopgen_q07/duckdb:vortex-compact 899356343 921585029 0.98
statpopgen_q08/duckdb:vortex-compact 921167974 937655937 0.98
statpopgen_q09/duckdb:vortex-compact 943565575 923178546 1.02
statpopgen_q10/duckdb:vortex-compact 2641712623 2616220020 1.01
duckdb / parquet (0.981x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 307086362 312733412 0.98
statpopgen_q01/duckdb:parquet 391525967 397944877 0.98
statpopgen_q02/duckdb:parquet 793013218 799640805 0.99
statpopgen_q03/duckdb:parquet 1208195884 1260073042 0.96
statpopgen_q04/duckdb:parquet 1221658832 1268023911 0.96
statpopgen_q05/duckdb:parquet 820271362 855332826 0.96
statpopgen_q06/duckdb:parquet 1468629717 1511693031 0.97
statpopgen_q07/duckdb:parquet 874916759 881680193 0.99
statpopgen_q08/duckdb:parquet 882023505 869284224 1.01
statpopgen_q09/duckdb:parquet 1044765061 1041693580 1.00
statpopgen_q10/duckdb:parquet 2219622257 2270488804 0.98
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB 143.50 KB -0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +1.8% -1.8% +3.7% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -5.0% -1.8% -3.3% +11.0% ➖ noise
1 duckdb:vortex-compact +0.2% -1.6% +1.9% +39.5% ➖ noise
1 duckdb:vortex-file-compressed -0.6% -1.6% +1.0% +214.2% ➖ noise
2 duckdb:vortex-compact -1.0% -0.8% -0.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.3% -0.8% +2.1% +10.0% ➖ noise
3 duckdb:vortex-compact +0.4% -4.1% +4.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.8% -4.1% +5.1% +10.0% ➖ noise
4 duckdb:vortex-compact -0.6% -3.7% +3.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.3% -3.7% +7.2% +10.0% ➖ noise
5 duckdb:vortex-compact -0.6% -4.1% +3.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -5.6% -4.1% -1.5% +10.4% ➖ noise
6 duckdb:vortex-compact +0.2% -2.8% +3.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.1% -2.8% +4.1% +10.0% ➖ noise
7 duckdb:vortex-compact -2.4% -0.8% -1.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +5.0% -0.8% +5.9% +10.0% ➖ noise
8 duckdb:vortex-compact -1.8% +1.5% -3.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.0% +1.5% -0.4% +10.0% ➖ noise
9 duckdb:vortex-compact +2.2% +0.3% +1.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +3.4% +0.3% +3.1% +10.0% ➖ noise
10 duckdb:vortex-compact +1.0% -2.2% +3.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.5% -2.2% +3.8% +10.0% ➖ noise

@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.933x ➖
Parquet (geomean): 0.946x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (0.936x ➖, 11↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 1681588 2595233 0.65
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1060253 1100217 0.96
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8181496127 8411745815 0.97
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8146819304 8305119529 0.98
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 3238606 3641802 0.89
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 2717517 2990239 0.91
random-access/feature-vectors/uniform/lance-tokio-local-disk 1170012 1227526 0.95
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1842029 1970789 0.93
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8343071064 8262199228 1.01
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8246159083 8354314855 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 6023680 6076599 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 5912397 5927560 1.00
random-access/lance-tokio-local-disk 625175 639746 0.98
random-access/lance-tokio-local-disk-footer 1295514 1302467 0.99
random-access/nested-lists/correlated/lance-tokio-local-disk 241064 253198 0.95
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 587200 613743 0.96
random-access/nested-lists/correlated/parquet-tokio-local-disk 128573693 138965523 0.93
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 128730729 138238031 0.93
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 553966 633614 0.87
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 565412 616395 0.92
random-access/nested-lists/uniform/lance-tokio-local-disk 🚀 982952 1111252 0.88
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1336839 1451569 0.92
random-access/nested-lists/uniform/parquet-tokio-local-disk 128758818 137196911 0.94
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 128363964 136574506 0.94
random-access/nested-lists/uniform/vortex-tokio-local-disk 2111694 2044284 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2106627 2067179 1.02
random-access/nested-structs/correlated/lance-tokio-local-disk 🚀 367412 419837 0.88
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 🚀 549495 636180 0.86
random-access/nested-structs/correlated/parquet-tokio-local-disk 22075149 24090210 0.92
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 22214423 23764336 0.93
random-access/nested-structs/correlated/vortex-tokio-local-disk 685243 697641 0.98
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 709388 706465 1.00
random-access/nested-structs/uniform/lance-tokio-local-disk 2559103 2686806 0.95
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2688211 2810891 0.96
random-access/nested-structs/uniform/parquet-tokio-local-disk 22196199 23653718 0.94
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 22028816 23252918 0.95
random-access/nested-structs/uniform/vortex-tokio-local-disk 1503684 1550758 0.97
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚀 1556933 1899440 0.82
random-access/parquet-tokio-local-disk 164452885 170910158 0.96
random-access/parquet-tokio-local-disk-footer 164208788 170696127 0.96
random-access/taxi/correlated/lance-tokio-local-disk 920744 938953 0.98
random-access/taxi/correlated/lance-tokio-local-disk-footer 1788975 1847879 0.97
random-access/taxi/correlated/parquet-tokio-local-disk 246782779 268912424 0.92
random-access/taxi/correlated/parquet-tokio-local-disk-footer 246636223 268054658 0.92
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1396184 1700893 0.82
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1537686 1727637 0.89
random-access/taxi/uniform/lance-tokio-local-disk 9328672 9437909 0.99
random-access/taxi/uniform/lance-tokio-local-disk-footer 9922133 9990504 0.99
random-access/taxi/uniform/parquet-tokio-local-disk 260554665 280698887 0.93
random-access/taxi/uniform/parquet-tokio-local-disk-footer 261680013 281293437 0.93
random-access/taxi/uniform/vortex-tokio-local-disk 4051995 4196561 0.97
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3954251 4129571 0.96
random-access/vortex-tokio-local-disk 🚀 1046845 1166938 0.90
random-access/vortex-tokio-local-disk-footer 🚀 1078864 1199617 0.90

@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (-0.1%, environment too noisy confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): 0.955x ➖
Parquet (geomean): 0.960x ➖
Shifts: Parquet (control) -4.0% · Median polish -4.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.932x ➖, 8↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 399501906 414166505 0.96
tpch_q02/datafusion:vortex-file-compressed 111267031 114012849 0.98
tpch_q03/datafusion:vortex-file-compressed 214024660 216976341 0.99
tpch_q04/datafusion:vortex-file-compressed 115499799 114950947 1.00
tpch_q05/datafusion:vortex-file-compressed 382968659 394112890 0.97
tpch_q06/datafusion:vortex-file-compressed 37413685 38626294 0.97
tpch_q07/datafusion:vortex-file-compressed 511263404 517065875 0.99
tpch_q08/datafusion:vortex-file-compressed 374889635 378415908 0.99
tpch_q09/datafusion:vortex-file-compressed 646439705 664613397 0.97
tpch_q10/datafusion:vortex-file-compressed 234034257 244308928 0.96
tpch_q11/datafusion:vortex-file-compressed 🚀 85843465 98234212 0.87
tpch_q12/datafusion:vortex-file-compressed 🚀 119546583 138174703 0.87
tpch_q13/datafusion:vortex-file-compressed 🚀 225035213 252751212 0.89
tpch_q14/datafusion:vortex-file-compressed 53576954 59412253 0.90
tpch_q15/datafusion:vortex-file-compressed 🚀 102350406 114901774 0.89
tpch_q16/datafusion:vortex-file-compressed 80088792 87173941 0.92
tpch_q17/datafusion:vortex-file-compressed 🚀 665482820 746797851 0.89
tpch_q18/datafusion:vortex-file-compressed 🚀 895258139 1002216827 0.89
tpch_q19/datafusion:vortex-file-compressed 🚀 80962809 92395012 0.88
tpch_q20/datafusion:vortex-file-compressed 170888941 189046123 0.90
tpch_q21/datafusion:vortex-file-compressed 🚀 689412414 781824725 0.88
tpch_q22/datafusion:vortex-file-compressed 67001725 69313172 0.97
datafusion / vortex-compact (0.950x ➖, 3↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 438358748 458084712 0.96
tpch_q02/datafusion:vortex-compact 116190447 121210093 0.96
tpch_q03/datafusion:vortex-compact 224027913 226353413 0.99
tpch_q04/datafusion:vortex-compact 124133350 128416218 0.97
tpch_q05/datafusion:vortex-compact 394655630 409943455 0.96
tpch_q06/datafusion:vortex-compact 60424641 63248545 0.96
tpch_q07/datafusion:vortex-compact 534413196 556275518 0.96
tpch_q08/datafusion:vortex-compact 380415415 399011227 0.95
tpch_q09/datafusion:vortex-compact 677522418 692596450 0.98
tpch_q10/datafusion:vortex-compact 249322182 253951967 0.98
tpch_q11/datafusion:vortex-compact 89392410 88534311 1.01
tpch_q12/datafusion:vortex-compact 160326406 174518107 0.92
tpch_q13/datafusion:vortex-compact 🚀 270589713 302967195 0.89
tpch_q14/datafusion:vortex-compact 70510178 77223385 0.91
tpch_q15/datafusion:vortex-compact 🚀 157130956 176465655 0.89
tpch_q16/datafusion:vortex-compact 84379268 91768611 0.92
tpch_q17/datafusion:vortex-compact 676637379 737915187 0.92
tpch_q18/datafusion:vortex-compact 🚀 868931605 971584065 0.89
tpch_q19/datafusion:vortex-compact 125444772 134640487 0.93
tpch_q20/datafusion:vortex-compact 194002908 187919334 1.03
tpch_q21/datafusion:vortex-compact 690533373 703779949 0.98
tpch_q22/datafusion:vortex-compact 72351449 75268939 0.96
datafusion / parquet (0.952x ➖, 4↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 443938784 448616311 0.99
tpch_q02/datafusion:parquet 174683285 175895874 0.99
tpch_q03/datafusion:parquet 287820903 287840383 1.00
tpch_q04/datafusion:parquet 129394712 130408162 0.99
tpch_q05/datafusion:parquet 442989773 438778419 1.01
tpch_q06/datafusion:parquet 126343825 124763222 1.01
tpch_q07/datafusion:parquet 615749858 606718361 1.01
tpch_q08/datafusion:parquet 473078371 469348612 1.01
tpch_q09/datafusion:parquet 760644411 837236810 0.91
tpch_q10/datafusion:parquet 503465259 558564822 0.90
tpch_q11/datafusion:parquet 123662226 133977743 0.92
tpch_q12/datafusion:parquet 206177224 215159366 0.96
tpch_q13/datafusion:parquet 335284421 362420370 0.93
tpch_q14/datafusion:parquet 🚀 158542255 177572550 0.89
tpch_q15/datafusion:parquet 257007789 274700456 0.94
tpch_q16/datafusion:parquet 🚀 120627316 137425704 0.88
tpch_q17/datafusion:parquet 🚀 693934037 783184852 0.89
tpch_q18/datafusion:parquet 🚀 911424715 1036719385 0.88
tpch_q19/datafusion:parquet 264779536 284201341 0.93
tpch_q20/datafusion:parquet 296703253 326365571 0.91
tpch_q21/datafusion:parquet 708282312 708500840 1.00
tpch_q22/datafusion:parquet 223468796 219694413 1.02
datafusion / arrow (0.969x ➖, 1↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 601305624 630241800 0.95
tpch_q02/datafusion:arrow 177146846 178949897 0.99
tpch_q03/datafusion:arrow 478119680 507099779 0.94
tpch_q04/datafusion:arrow 364644028 370808808 0.98
tpch_q05/datafusion:arrow 975532273 1074238237 0.91
tpch_q06/datafusion:arrow 282184842 312890446 0.90
tpch_q07/datafusion:arrow 1170105198 1232723312 0.95
tpch_q08/datafusion:arrow 1132152775 1170441468 0.97
tpch_q09/datafusion:arrow 1352987238 1376898010 0.98
tpch_q10/datafusion:arrow 591515236 599154876 0.99
tpch_q11/datafusion:arrow 140107506 143838804 0.97
tpch_q12/datafusion:arrow 🚀 711906095 793915443 0.90
tpch_q13/datafusion:arrow 495588551 515088464 0.96
tpch_q14/datafusion:arrow 327802539 325961714 1.01
tpch_q15/datafusion:arrow 740506276 708206738 1.05
tpch_q16/datafusion:arrow 107619577 109366661 0.98
tpch_q17/datafusion:arrow 1343522987 1394163047 0.96
tpch_q18/datafusion:arrow 1958152964 1981305140 0.99
tpch_q19/datafusion:arrow 488646949 501710823 0.97
tpch_q20/datafusion:arrow 492735489 505970257 0.97
tpch_q21/datafusion:arrow 3027284975 2988933200 1.01
tpch_q22/datafusion:arrow 132465373 135148760 0.98
duckdb / vortex-file-compressed (0.960x ➖, 2↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 170309958 178630695 0.95
tpch_q02/duckdb:vortex-file-compressed 51313849 55188805 0.93
tpch_q03/duckdb:vortex-file-compressed 🚀 120864348 135195658 0.89
tpch_q04/duckdb:vortex-file-compressed 157552561 170015433 0.93
tpch_q05/duckdb:vortex-file-compressed 136371641 144298366 0.95
tpch_q06/duckdb:vortex-file-compressed 34326979 34628370 0.99
tpch_q07/duckdb:vortex-file-compressed 132198585 137055191 0.96
tpch_q08/duckdb:vortex-file-compressed 168872780 168872919 1.00
tpch_q09/duckdb:vortex-file-compressed 395279232 406032398 0.97
tpch_q10/duckdb:vortex-file-compressed 191546311 198221575 0.97
tpch_q11/duckdb:vortex-file-compressed 32545208 32143552 1.01
tpch_q12/duckdb:vortex-file-compressed 100766076 100834469 1.00
tpch_q13/duckdb:vortex-file-compressed 274333262 285766919 0.96
tpch_q14/duckdb:vortex-file-compressed 53520425 53138465 1.01
tpch_q15/duckdb:vortex-file-compressed 89670241 89186993 1.01
tpch_q16/duckdb:vortex-file-compressed 77627118 77046730 1.01
tpch_q17/duckdb:vortex-file-compressed 93500725 97009303 0.96
tpch_q18/duckdb:vortex-file-compressed 🚀 286161399 410499799 0.70
tpch_q19/duckdb:vortex-file-compressed 79773096 79870790 1.00
tpch_q20/duckdb:vortex-file-compressed 142012534 141808163 1.00
tpch_q21/duckdb:vortex-file-compressed 492302869 488094466 1.01
tpch_q22/duckdb:vortex-file-compressed 63729927 65616479 0.97
duckdb / vortex-compact (0.978x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 231242019 233175648 0.99
tpch_q02/duckdb:vortex-compact 56826257 58863407 0.97
tpch_q03/duckdb:vortex-compact 136227683 142703449 0.95
tpch_q04/duckdb:vortex-compact 171490476 181662540 0.94
tpch_q05/duckdb:vortex-compact 164083680 167356571 0.98
tpch_q06/duckdb:vortex-compact 57809015 60390283 0.96
tpch_q07/duckdb:vortex-compact 173539780 176685482 0.98
tpch_q08/duckdb:vortex-compact 186134442 195144383 0.95
tpch_q09/duckdb:vortex-compact 427455784 437309959 0.98
tpch_q10/duckdb:vortex-compact 238204111 224138823 1.06
tpch_q11/duckdb:vortex-compact 43261995 39845458 1.09
tpch_q12/duckdb:vortex-compact 165516790 165698235 1.00
tpch_q13/duckdb:vortex-compact 350924014 332315505 1.06
tpch_q14/duckdb:vortex-compact 72582603 74064377 0.98
tpch_q15/duckdb:vortex-compact 114426552 115420368 0.99
tpch_q16/duckdb:vortex-compact 82777284 78396531 1.06
tpch_q17/duckdb:vortex-compact 107874436 113698455 0.95
tpch_q18/duckdb:vortex-compact 289577466 306846588 0.94
tpch_q19/duckdb:vortex-compact 96605480 102854173 0.94
tpch_q20/duckdb:vortex-compact 176152597 191580042 0.92
tpch_q21/duckdb:vortex-compact 522788378 575042624 0.91
tpch_q22/duckdb:vortex-compact 72141280 77236662 0.93
duckdb / parquet (0.969x ➖, 1↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 262944276 273991179 0.96
tpch_q02/duckdb:parquet 103390232 104870084 0.99
tpch_q03/duckdb:parquet 214305369 220234753 0.97
tpch_q04/duckdb:parquet 138374270 145692664 0.95
tpch_q05/duckdb:parquet 227169120 235944224 0.96
tpch_q06/duckdb:parquet 73373088 77596135 0.95
tpch_q07/duckdb:parquet 186920789 196358945 0.95
tpch_q08/duckdb:parquet 262385954 284501809 0.92
tpch_q09/duckdb:parquet 480452617 494821381 0.97
tpch_q10/duckdb:parquet 626242142 639062817 0.98
tpch_q11/duckdb:parquet 66237795 66159337 1.00
tpch_q12/duckdb:parquet 131050861 135858076 0.96
tpch_q13/duckdb:parquet 452892808 431535439 1.05
tpch_q14/duckdb:parquet 184177887 187607860 0.98
tpch_q15/duckdb:parquet 105093070 109523249 0.96
tpch_q16/duckdb:parquet 166028021 165476901 1.00
tpch_q17/duckdb:parquet 182640071 182802653 1.00
tpch_q18/duckdb:parquet 363662854 370607929 0.98
tpch_q19/duckdb:parquet 287801612 295345133 0.97
tpch_q20/duckdb:parquet 234198877 242280999 0.97
tpch_q21/duckdb:parquet 🚀 552001628 621726057 0.89
tpch_q22/duckdb:parquet 292429935 304647214 0.96
duckdb / duckdb (0.951x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 120776428 123496930 0.98
tpch_q02/duckdb:duckdb 49802781 52007241 0.96
tpch_q03/duckdb:duckdb 104134032 111212204 0.94
tpch_q04/duckdb:duckdb 140341810 153971163 0.91
tpch_q05/duckdb:duckdb 118718409 131104881 0.91
tpch_q06/duckdb:duckdb 44453145 46713867 0.95
tpch_q07/duckdb:duckdb 91118387 96157356 0.95
tpch_q08/duckdb:duckdb 118752142 129293584 0.92
tpch_q09/duckdb:duckdb 281695744 298292580 0.94
tpch_q10/duckdb:duckdb 213474000 214685346 0.99
tpch_q11/duckdb:duckdb 19814820 19021971 1.04
tpch_q12/duckdb:duckdb 90069198 89693969 1.00
tpch_q13/duckdb:duckdb 231500012 247931662 0.93
tpch_q14/duckdb:duckdb 78207617 83031946 0.94
tpch_q15/duckdb:duckdb 81414054 86249527 0.94
tpch_q16/duckdb:duckdb 76438983 84752498 0.90
tpch_q17/duckdb:duckdb 89423528 90754940 0.99
tpch_q18/duckdb:duckdb 237242637 248711915 0.95
tpch_q19/duckdb:duckdb 124690904 130165431 0.96
tpch_q20/duckdb:duckdb 118088382 123128067 0.96
tpch_q21/duckdb:duckdb 304831420 335812201 0.91
tpch_q22/duckdb:duckdb 69662448 71973180 0.97
File Size Changes (26 files changed, +0.0% overall, 14↑ 12↓)
File Scale Format Base HEAD Change %
partsupp_0.vortex 10.0 vortex-compact 104.43 MB 105.66 MB +1.23 MB +1.2%
supplier_0.vortex 10.0 vortex-file-compressed 5.70 MB 5.73 MB +31.90 KB +0.5%
partsupp_1.vortex 10.0 vortex-compact 104.87 MB 105.24 MB +377.94 KB +0.4%
orders_1.vortex 10.0 vortex-file-compressed 145.73 MB 146.23 MB +512.02 KB +0.3%
orders_0.vortex 10.0 vortex-file-compressed 144.56 MB 144.91 MB +363.59 KB +0.2%
lineitem_2.vortex 10.0 vortex-file-compressed 133.95 MB 134.27 MB +328.34 KB +0.2%
lineitem_0.vortex 10.0 vortex-file-compressed 134.08 MB 134.29 MB +211.71 KB +0.2%
part_1.vortex 10.0 vortex-file-compressed 24.73 MB 24.76 MB +33.20 KB +0.1%
lineitem_11.vortex 10.0 vortex-file-compressed 134.29 MB 134.38 MB +99.91 KB +0.1%
lineitem_3.vortex 10.0 vortex-file-compressed 133.22 MB 133.29 MB +72.16 KB +0.1%
partsupp_0.vortex 10.0 vortex-file-compressed 120.30 MB 120.35 MB +55.28 KB +0.0%
lineitem_9.vortex 10.0 vortex-file-compressed 134.21 MB 134.26 MB +54.81 KB +0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 134.08 MB 134.11 MB +32.59 KB +0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 120.28 MB 120.31 MB +27.61 KB +0.0%
customer_0.vortex 10.0 vortex-file-compressed 88.53 MB 88.52 MB 8.23 KB -0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 134.11 MB 134.04 MB 68.88 KB -0.1%
lineitem_7.vortex 10.0 vortex-file-compressed 133.60 MB 133.53 MB 70.52 KB -0.1%
lineitem_1.vortex 10.0 vortex-file-compressed 133.78 MB 133.69 MB 90.65 KB -0.1%
lineitem_5.vortex 10.0 vortex-file-compressed 133.59 MB 133.50 MB 96.15 KB -0.1%
lineitem_8.vortex 10.0 vortex-file-compressed 133.54 MB 133.41 MB 129.41 KB -0.1%
lineitem_10.vortex 10.0 vortex-file-compressed 134.20 MB 134.02 MB 183.12 KB -0.1%
lineitem_6.vortex 10.0 vortex-file-compressed 132.87 MB 132.67 MB 197.69 KB -0.1%
orders_2.vortex 10.0 vortex-file-compressed 145.71 MB 145.40 MB 320.68 KB -0.2%
part_0.vortex 10.0 vortex-file-compressed 24.79 MB 24.74 MB 57.90 KB -0.2%
part_1.vortex 10.0 vortex-compact 17.08 MB 16.97 MB 114.98 KB -0.7%
part_0.vortex 10.0 vortex-compact 17.12 MB 17.00 MB 124.54 KB -0.7%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (+0.1%)
  • vortex-file-compressed: 2.50 GB → 2.50 GB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -4.6% -2.5% -2.1% +10.0% ➖ noise
1 datafusion:vortex-compact -4.3% -2.5% -1.8% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -3.5% -2.5% -1.0% +10.0% ➖ noise
1 duckdb:duckdb -2.2% -2.5% +0.4% +10.0% ➖ noise
1 duckdb:vortex-compact -0.8% -2.5% +1.8% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -4.7% -2.5% -2.2% +10.0% ➖ noise
2 datafusion:arrow -1.0% -1.1% +0.0% +10.0% ➖ noise
2 datafusion:vortex-compact -4.1% -1.1% -3.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -2.4% -1.1% -1.4% +10.0% ➖ noise
2 duckdb:duckdb -4.2% -1.1% -3.2% +10.0% ➖ noise
2 duckdb:vortex-compact -3.5% -1.1% -2.4% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -7.0% -1.1% -6.0% +13.7% ➖ noise
3 datafusion:arrow -5.7% -1.4% -4.4% +10.0% ➖ noise
3 datafusion:vortex-compact -1.0% -1.4% +0.3% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.4% -1.4% -0.0% +10.0% ➖ noise
3 duckdb:duckdb -6.4% -1.4% -5.1% +10.0% ➖ noise
3 duckdb:vortex-compact -4.5% -1.4% -3.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -10.6% -1.4% -9.4% +10.0% ✅ faster
4 datafusion:arrow -1.7% -2.9% +1.3% +10.0% ➖ noise
4 datafusion:vortex-compact -3.3% -2.9% -0.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.5% -2.9% +3.5% +10.0% ➖ noise
4 duckdb:duckdb -8.9% -2.9% -6.1% +10.0% ➖ noise
4 duckdb:vortex-compact -5.6% -2.9% -2.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -7.3% -2.9% -4.5% +10.0% ➖ noise
5 datafusion:arrow -9.2% -1.4% -7.9% +10.0% ➖ noise
5 datafusion:vortex-compact -3.7% -1.4% -2.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.8% -1.4% -1.4% +10.0% ➖ noise
5 duckdb:duckdb -9.4% -1.4% -8.2% +10.0% ➖ noise
5 duckdb:vortex-compact -2.0% -1.4% -0.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -5.5% -1.4% -4.1% +10.0% ➖ noise
6 datafusion:arrow -9.8% -2.1% -7.8% +10.0% ➖ noise
6 datafusion:vortex-compact -4.5% -2.1% -2.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -3.1% -2.1% -1.0% +10.0% ➖ noise
6 duckdb:duckdb -4.8% -2.1% -2.8% +10.0% ➖ noise
6 duckdb:vortex-compact -4.3% -2.1% -2.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.9% -2.1% +1.3% +12.1% ➖ noise
7 datafusion:arrow -5.1% -1.7% -3.4% +10.0% ➖ noise
7 datafusion:vortex-compact -3.9% -1.7% -2.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.1% -1.7% +0.6% +10.0% ➖ noise
7 duckdb:duckdb -5.2% -1.7% -3.6% +10.0% ➖ noise
7 duckdb:vortex-compact -1.8% -1.7% -0.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.5% -1.7% -1.9% +10.0% ➖ noise
8 datafusion:arrow -3.3% -3.6% +0.3% +10.0% ➖ noise
8 datafusion:vortex-compact -4.7% -3.6% -1.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.9% -3.6% +2.8% +10.0% ➖ noise
8 duckdb:duckdb -8.2% -3.6% -4.7% +10.0% ➖ noise
8 duckdb:vortex-compact -4.6% -3.6% -1.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.0% -3.6% +3.7% +10.0% ➖ noise
9 datafusion:arrow -1.7% -6.1% +4.6% +10.0% ➖ noise
9 datafusion:vortex-compact -2.2% -6.1% +4.2% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -2.7% -6.1% +3.6% +10.0% ➖ noise
9 duckdb:duckdb -5.6% -6.1% +0.5% +10.0% ➖ noise
9 duckdb:vortex-compact -2.3% -6.1% +4.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.6% -6.1% +3.7% +10.0% ➖ noise
10 datafusion:arrow -1.3% -6.0% +5.0% +10.0% ➖ noise
10 datafusion:vortex-compact -1.8% -6.0% +4.5% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -4.2% -6.0% +1.9% +10.0% ➖ noise
10 duckdb:duckdb -0.6% -6.0% +5.8% +10.0% ➖ noise
10 duckdb:vortex-compact +6.3% -6.0% +13.1% +10.0% 🚨 regression
10 duckdb:vortex-file-compressed -3.4% -6.0% +2.8% +10.0% ➖ noise
11 datafusion:arrow -2.6% -3.9% +1.3% +15.7% ➖ noise
11 datafusion:vortex-compact +1.0% -3.9% +5.0% +10.4% ➖ noise
11 datafusion:vortex-file-compressed -12.6% -3.9% -9.1% +10.2% ➖ noise
11 duckdb:duckdb +4.2% -3.9% +8.4% +14.9% ➖ noise
11 duckdb:vortex-compact +8.6% -3.9% +12.9% +10.9% 🚨 regression
11 duckdb:vortex-file-compressed +1.2% -3.9% +5.3% +11.8% ➖ noise
12 datafusion:arrow -10.3% -3.9% -6.7% +34.5% ➖ noise
12 datafusion:vortex-compact -8.1% -3.9% -4.4% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -13.5% -3.9% -10.0% +10.0% ✅ faster
12 duckdb:duckdb +0.4% -3.9% +4.4% +10.0% ➖ noise
12 duckdb:vortex-compact -0.1% -3.9% +3.9% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -0.1% -3.9% +3.9% +10.0% ➖ noise
13 datafusion:arrow -3.8% -1.5% -2.4% +10.0% ➖ noise
13 datafusion:vortex-compact -10.7% -1.5% -9.4% +10.0% ✅ faster
13 datafusion:vortex-file-compressed -11.0% -1.5% -9.6% +10.0% ✅ faster
13 duckdb:duckdb -6.6% -1.5% -5.2% +10.0% ➖ noise
13 duckdb:vortex-compact +5.6% -1.5% +7.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -4.0% -1.5% -2.6% +10.0% ➖ noise
14 datafusion:arrow +0.6% -6.4% +7.4% +10.0% ➖ noise
14 datafusion:vortex-compact -8.7% -6.4% -2.5% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -9.8% -6.4% -3.7% +10.0% ➖ noise
14 duckdb:duckdb -5.8% -6.4% +0.6% +10.0% ➖ noise
14 duckdb:vortex-compact -2.0% -6.4% +4.7% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.7% -6.4% +7.6% +10.6% ➖ noise
15 datafusion:arrow +4.6% -5.3% +10.4% +10.0% 🚨 regression
15 datafusion:vortex-compact -11.0% -5.3% -6.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -10.9% -5.3% -6.0% +10.0% ➖ noise
15 duckdb:duckdb -5.6% -5.3% -0.4% +10.0% ➖ noise
15 duckdb:vortex-compact -0.9% -5.3% +4.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.5% -5.3% +6.1% +10.0% ➖ noise
16 datafusion:arrow -1.6% -6.2% +4.9% +10.0% ➖ noise
16 datafusion:vortex-compact -8.1% -6.2% -2.0% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -8.1% -6.2% -2.1% +10.0% ➖ noise
16 duckdb:duckdb -9.8% -6.2% -3.9% +10.0% ➖ noise
16 duckdb:vortex-compact +5.6% -6.2% +12.5% +10.0% 🚨 regression
16 duckdb:vortex-file-compressed +0.8% -6.2% +7.4% +10.0% ➖ noise
17 datafusion:arrow -3.6% -5.9% +2.4% +10.0% ➖ noise
17 datafusion:vortex-compact -8.3% -5.9% -2.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -10.9% -5.9% -5.3% +10.0% ➖ noise
17 duckdb:duckdb -1.5% -5.9% +4.7% +10.0% ➖ noise
17 duckdb:vortex-compact -5.1% -5.9% +0.8% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -3.6% -5.9% +2.4% +15.8% ➖ noise
18 datafusion:arrow -1.2% -7.1% +6.4% +10.0% ➖ noise
18 datafusion:vortex-compact -10.6% -7.1% -3.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -10.7% -7.1% -3.8% +10.0% ➖ noise
18 duckdb:duckdb -4.6% -7.1% +2.7% +10.0% ➖ noise
18 duckdb:vortex-compact -5.6% -7.1% +1.6% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -30.3% -7.1% -24.9% +18.3% ✅ faster
19 datafusion:arrow -2.6% -4.7% +2.2% +10.0% ➖ noise
19 datafusion:vortex-compact -6.8% -4.7% -2.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -12.4% -4.7% -8.0% +10.0% ➖ noise
19 duckdb:duckdb -4.2% -4.7% +0.5% +10.0% ➖ noise
19 duckdb:vortex-compact -6.1% -4.7% -1.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -0.1% -4.7% +4.8% +10.0% ➖ noise
20 datafusion:arrow -2.6% -6.3% +3.9% +10.0% ➖ noise
20 datafusion:vortex-compact +3.2% -6.3% +10.1% +10.0% 🚨 regression
20 datafusion:vortex-file-compressed -9.6% -6.3% -3.6% +10.0% ➖ noise
20 duckdb:duckdb -4.1% -6.3% +2.3% +10.0% ➖ noise
20 duckdb:vortex-compact -8.1% -6.3% -1.9% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.1% -6.3% +6.8% +10.0% ➖ noise
21 datafusion:arrow +1.3% -5.8% +7.5% +10.0% ➖ noise
21 datafusion:vortex-compact -1.9% -5.8% +4.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -11.8% -5.8% -6.4% +10.0% ➖ noise
21 duckdb:duckdb -9.2% -5.8% -3.6% +10.0% ➖ noise
21 duckdb:vortex-compact -9.1% -5.8% -3.5% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.9% -5.8% +7.1% +10.0% ➖ noise
22 datafusion:arrow -2.0% -1.2% -0.8% +10.0% ➖ noise
22 datafusion:vortex-compact -3.9% -1.2% -2.7% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -3.3% -1.2% -2.2% +10.0% ➖ noise
22 duckdb:duckdb -3.2% -1.2% -2.0% +10.0% ➖ noise
22 duckdb:vortex-compact -6.6% -1.2% -5.5% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -2.9% -1.2% -1.7% +12.8% ➖ noise

@myrrc myrrc requested a review from joseph-isaacs June 3, 2026 11:27
@myrrc myrrc added the changelog/performance A performance improvement label Jun 3, 2026
@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.7%
Engines: DataFusion No clear signal (+15.8%, environment too noisy confidence) · DuckDB No clear signal (-7.0%, environment too noisy confidence)
Vortex (geomean): 1.176x ➖
Parquet (geomean): 1.134x ➖
Shifts: Parquet (control) +13.4% · Median polish +17.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.363x ❌, 0↑ 15↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 382429250 256479452 1.49
tpch_q02/datafusion:vortex-file-compressed 🚨 788883839 467868318 1.69
tpch_q03/datafusion:vortex-file-compressed 🚨 649773871 493029655 1.32
tpch_q04/datafusion:vortex-file-compressed 🚨 382446562 267885526 1.43
tpch_q05/datafusion:vortex-file-compressed 🚨 605004301 442142066 1.37
tpch_q06/datafusion:vortex-file-compressed 🚨 536146622 345413503 1.55
tpch_q07/datafusion:vortex-file-compressed 🚨 725016324 446081898 1.63
tpch_q08/datafusion:vortex-file-compressed 🚨 956323872 689064468 1.39
tpch_q09/datafusion:vortex-file-compressed 🚨 790509775 425308282 1.86
tpch_q10/datafusion:vortex-file-compressed 🚨 917018735 539103867 1.70
tpch_q11/datafusion:vortex-file-compressed 🚨 404050070 293944952 1.37
tpch_q12/datafusion:vortex-file-compressed 568545534 452271455 1.26
tpch_q13/datafusion:vortex-file-compressed 145900636 157994890 0.92
tpch_q14/datafusion:vortex-file-compressed 🚨 341993679 226199080 1.51
tpch_q15/datafusion:vortex-file-compressed 🚨 635604687 485903070 1.31
tpch_q16/datafusion:vortex-file-compressed 270439889 216464387 1.25
tpch_q17/datafusion:vortex-file-compressed 🚨 630499136 359197278 1.76
tpch_q18/datafusion:vortex-file-compressed 464666339 361401657 1.29
tpch_q19/datafusion:vortex-file-compressed 🚨 640529881 482144757 1.33
tpch_q20/datafusion:vortex-file-compressed 439071228 421643117 1.04
tpch_q21/datafusion:vortex-file-compressed 731906550 644977713 1.13
tpch_q22/datafusion:vortex-file-compressed 125910324 138523886 0.91
datafusion / vortex-compact (1.366x ❌, 0↑ 12↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 288470937 266094675 1.08
tpch_q02/datafusion:vortex-compact 466612740 433110893 1.08
tpch_q03/datafusion:vortex-compact 436355374 396506380 1.10
tpch_q04/datafusion:vortex-compact 269611769 212063096 1.27
tpch_q05/datafusion:vortex-compact 🚨 570570132 346592726 1.65
tpch_q06/datafusion:vortex-compact 🚨 405657829 265769108 1.53
tpch_q07/datafusion:vortex-compact 🚨 629743852 408061613 1.54
tpch_q08/datafusion:vortex-compact 🚨 922864358 593628791 1.55
tpch_q09/datafusion:vortex-compact 🚨 745691504 429903765 1.73
tpch_q10/datafusion:vortex-compact 🚨 580212730 388499561 1.49
tpch_q11/datafusion:vortex-compact 🚨 496542330 272324037 1.82
tpch_q12/datafusion:vortex-compact 431106685 363851916 1.18
tpch_q13/datafusion:vortex-compact 147520939 114050718 1.29
tpch_q14/datafusion:vortex-compact 257353996 260475649 0.99
tpch_q15/datafusion:vortex-compact 🚨 642745868 389380641 1.65
tpch_q16/datafusion:vortex-compact 228361129 191486687 1.19
tpch_q17/datafusion:vortex-compact 🚨 529805465 376133852 1.41
tpch_q18/datafusion:vortex-compact 🚨 507980908 303768554 1.67
tpch_q19/datafusion:vortex-compact 🚨 754223138 482392574 1.56
tpch_q20/datafusion:vortex-compact 🚨 649329798 430940675 1.51
tpch_q21/datafusion:vortex-compact 579655790 587215744 0.99
tpch_q22/datafusion:vortex-compact 134597307 107471209 1.25
datafusion / parquet (1.179x ➖, 0↑ 6↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 223335286 240969353 0.93
tpch_q02/datafusion:parquet 429436087 426946643 1.01
tpch_q03/datafusion:parquet 358305714 459442833 0.78
tpch_q04/datafusion:parquet 227551154 217698850 1.05
tpch_q05/datafusion:parquet 518577381 472296416 1.10
tpch_q06/datafusion:parquet 148512144 179918918 0.83
tpch_q07/datafusion:parquet 506251147 492967213 1.03
tpch_q08/datafusion:parquet 651393884 602847283 1.08
tpch_q09/datafusion:parquet 479226339 461784299 1.04
tpch_q10/datafusion:parquet 631779355 516232896 1.22
tpch_q11/datafusion:parquet 426179061 342053479 1.25
tpch_q12/datafusion:parquet 256792338 247867753 1.04
tpch_q13/datafusion:parquet 553338006 434229308 1.27
tpch_q14/datafusion:parquet 🚨 326925416 220809933 1.48
tpch_q15/datafusion:parquet 524856169 405318223 1.29
tpch_q16/datafusion:parquet 🚨 252128219 170757238 1.48
tpch_q17/datafusion:parquet 509179969 421160659 1.21
tpch_q18/datafusion:parquet 🚨 605624051 454284472 1.33
tpch_q19/datafusion:parquet 🚨 570908974 359829863 1.59
tpch_q20/datafusion:parquet 🚨 502276437 342681775 1.47
tpch_q21/datafusion:parquet 887898940 696434506 1.27
tpch_q22/datafusion:parquet 🚨 277008260 161212774 1.72
duckdb / vortex-file-compressed (1.024x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 295126237 263986719 1.12
tpch_q02/duckdb:vortex-file-compressed 1099330983 1030436913 1.07
tpch_q03/duckdb:vortex-file-compressed 683547884 636460481 1.07
tpch_q04/duckdb:vortex-file-compressed 511638149 431819088 1.18
tpch_q05/duckdb:vortex-file-compressed 927618485 882405367 1.05
tpch_q06/duckdb:vortex-file-compressed 354196677 353162625 1.00
tpch_q07/duckdb:vortex-file-compressed 1091144958 915619990 1.19
tpch_q08/duckdb:vortex-file-compressed 1102480750 1055148518 1.04
tpch_q09/duckdb:vortex-file-compressed 1036823289 966071695 1.07
tpch_q10/duckdb:vortex-file-compressed 869861124 817696567 1.06
tpch_q11/duckdb:vortex-file-compressed 486526727 525237938 0.93
tpch_q12/duckdb:vortex-file-compressed 683161042 844093901 0.81
tpch_q13/duckdb:vortex-file-compressed 419289038 504802766 0.83
tpch_q14/duckdb:vortex-file-compressed 441122225 415958533 1.06
tpch_q15/duckdb:vortex-file-compressed 326774453 284559997 1.15
tpch_q16/duckdb:vortex-file-compressed 350517213 324260088 1.08
tpch_q17/duckdb:vortex-file-compressed 739283868 794880245 0.93
tpch_q18/duckdb:vortex-file-compressed 612794139 670450500 0.91
tpch_q19/duckdb:vortex-file-compressed 502386725 538308510 0.93
tpch_q20/duckdb:vortex-file-compressed 906011917 828447589 1.09
tpch_q21/duckdb:vortex-file-compressed 1234104583 1187910402 1.04
tpch_q22/duckdb:vortex-file-compressed 283714884 285122588 1.00
duckdb / vortex-compact (1.005x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 261934262 299605223 0.87
tpch_q02/duckdb:vortex-compact 939591415 1026805344 0.92
tpch_q03/duckdb:vortex-compact 696957176 716572149 0.97
tpch_q04/duckdb:vortex-compact 516982492 455222517 1.14
tpch_q05/duckdb:vortex-compact 957658715 849705985 1.13
tpch_q06/duckdb:vortex-compact 415322971 358186475 1.16
tpch_q07/duckdb:vortex-compact 922770852 990782699 0.93
tpch_q08/duckdb:vortex-compact 1116883811 972613736 1.15
tpch_q09/duckdb:vortex-compact 1086435114 994885421 1.09
tpch_q10/duckdb:vortex-compact 758240916 728998830 1.04
tpch_q11/duckdb:vortex-compact 468147674 539765775 0.87
tpch_q12/duckdb:vortex-compact 703077831 672163957 1.05
tpch_q13/duckdb:vortex-compact 445503855 431040278 1.03
tpch_q14/duckdb:vortex-compact 393196234 400265044 0.98
tpch_q15/duckdb:vortex-compact 337936136 334041437 1.01
tpch_q16/duckdb:vortex-compact 320593730 394594262 0.81
tpch_q17/duckdb:vortex-compact 666265660 773731208 0.86
tpch_q18/duckdb:vortex-compact 567815730 509404104 1.11
tpch_q19/duckdb:vortex-compact 539998186 480890704 1.12
tpch_q20/duckdb:vortex-compact 882397693 803855631 1.10
tpch_q21/duckdb:vortex-compact 1052429211 1033605084 1.02
tpch_q22/duckdb:vortex-compact 290668251 330483744 0.88
duckdb / parquet (1.091x ➖, 0↑ 1↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 564669922 441278955 1.28
tpch_q02/duckdb:parquet 1207045088 1099752653 1.10
tpch_q03/duckdb:parquet 1253809125 1011927630 1.24
tpch_q04/duckdb:parquet 826915730 699010170 1.18
tpch_q05/duckdb:parquet 1463873609 1320519604 1.11
tpch_q06/duckdb:parquet 🚨 573456698 419076568 1.37
tpch_q07/duckdb:parquet 1308694272 1125926092 1.16
tpch_q08/duckdb:parquet 1579427645 1408276097 1.12
tpch_q09/duckdb:parquet 1490738095 1359980628 1.10
tpch_q10/duckdb:parquet 1418697928 1297568602 1.09
tpch_q11/duckdb:parquet 754504408 760284505 0.99
tpch_q12/duckdb:parquet 676933795 748960415 0.90
tpch_q13/duckdb:parquet 941508939 944313298 1.00
tpch_q14/duckdb:parquet 748174221 710175773 1.05
tpch_q15/duckdb:parquet 555659379 500285955 1.11
tpch_q16/duckdb:parquet 665949276 662770662 1.00
tpch_q17/duckdb:parquet 816548783 777564972 1.05
tpch_q18/duckdb:parquet 879555760 940627857 0.94
tpch_q19/duckdb:parquet 907119992 780712148 1.16
tpch_q20/duckdb:parquet 1241163047 1233770557 1.01
tpch_q21/duckdb:parquet 1165361068 1061460749 1.10
tpch_q22/duckdb:parquet 625411395 590217522 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +8.4% +8.9% -0.5% +75.8% ➖ noise
1 datafusion:vortex-file-compressed +49.1% +8.9% +36.9% +70.9% ➖ noise
1 duckdb:vortex-compact -12.6% +8.9% -19.7% +57.0% ➖ noise
1 duckdb:vortex-file-compressed +11.8% +8.9% +2.7% +40.1% ➖ noise
2 datafusion:vortex-compact +7.7% +5.1% +2.5% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +68.6% +5.1% +60.5% +34.4% 🚨 regression
2 duckdb:vortex-compact -8.5% +5.1% -12.9% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +6.7% +5.1% +1.5% +30.0% ➖ noise
3 datafusion:vortex-compact +10.1% -1.7% +12.0% +45.5% ➖ noise
3 datafusion:vortex-file-compressed +31.8% -1.7% +34.1% +58.0% ➖ noise
3 duckdb:vortex-compact -2.7% -1.7% -1.1% +30.6% ➖ noise
3 duckdb:vortex-file-compressed +7.4% -1.7% +9.3% +35.9% ➖ noise
4 datafusion:vortex-compact +27.1% +11.2% +14.3% +41.8% ➖ noise
4 datafusion:vortex-file-compressed +42.8% +11.2% +28.4% +41.7% ➖ noise
4 duckdb:vortex-compact +13.6% +11.2% +2.1% +47.1% ➖ noise
4 duckdb:vortex-file-compressed +18.5% +11.2% +6.6% +35.1% ➖ noise
5 datafusion:vortex-compact +64.6% +10.3% +49.2% +31.9% 🚨 regression
5 datafusion:vortex-file-compressed +36.8% +10.3% +24.0% +30.0% ➖ noise
5 duckdb:vortex-compact +12.7% +10.3% +2.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +5.1% +10.3% -4.7% +30.0% ➖ noise
6 datafusion:vortex-compact +52.6% +6.3% +43.6% +30.0% 🚨 regression
6 datafusion:vortex-file-compressed +55.2% +6.3% +46.0% +30.0% 🚨 regression
6 duckdb:vortex-compact +16.0% +6.3% +9.1% +33.3% ➖ noise
6 duckdb:vortex-file-compressed +0.3% +6.3% -5.6% +30.0% ➖ noise
7 datafusion:vortex-compact +54.3% +9.3% +41.3% +30.0% 🚨 regression
7 datafusion:vortex-file-compressed +62.5% +9.3% +48.8% +30.0% 🚨 regression
7 duckdb:vortex-compact -6.9% +9.3% -14.8% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +19.2% +9.3% +9.1% +30.0% ➖ noise
8 datafusion:vortex-compact +55.5% +10.1% +41.2% +30.3% 🚨 regression
8 datafusion:vortex-file-compressed +38.8% +10.1% +26.1% +30.0% ➖ noise
8 duckdb:vortex-compact +14.8% +10.1% +4.3% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +4.5% +10.1% -5.1% +30.0% ➖ noise
9 datafusion:vortex-compact +73.5% +6.7% +62.6% +30.0% 🚨 regression
9 datafusion:vortex-file-compressed +85.9% +6.7% +74.3% +30.0% 🚨 regression
9 duckdb:vortex-compact +9.2% +6.7% +2.4% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +7.3% +6.7% +0.6% +30.0% ➖ noise
10 datafusion:vortex-compact +49.3% +15.7% +29.1% +37.7% ➖ noise
10 datafusion:vortex-file-compressed +70.1% +15.7% +47.1% +30.0% 🚨 regression
10 duckdb:vortex-compact +4.0% +15.7% -10.1% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +6.4% +15.7% -8.0% +30.0% ➖ noise
11 datafusion:vortex-compact +82.3% +11.2% +64.0% +46.9% 🚨 regression
11 datafusion:vortex-file-compressed +37.5% +11.2% +23.6% +30.0% ➖ noise
11 duckdb:vortex-compact -13.3% +11.2% -22.0% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -7.4% +11.2% -16.7% +30.0% ➖ noise
12 datafusion:vortex-compact +18.5% -3.2% +22.4% +32.6% ➖ noise
12 datafusion:vortex-file-compressed +25.7% -3.2% +29.9% +32.8% ➖ noise
12 duckdb:vortex-compact +4.6% -3.2% +8.1% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -19.1% -3.2% -16.4% +31.8% ➖ noise
13 datafusion:vortex-compact +29.3% +12.7% +14.8% +65.1% ➖ noise
13 datafusion:vortex-file-compressed -7.7% +12.7% -18.1% +40.5% ➖ noise
13 duckdb:vortex-compact +3.4% +12.7% -8.3% +30.0% ➖ noise
13 duckdb:vortex-file-compressed -16.9% +12.7% -26.3% +30.0% ✅ faster
14 datafusion:vortex-compact -1.2% +24.9% -20.9% +38.5% ➖ noise
14 datafusion:vortex-file-compressed +51.2% +24.9% +21.1% +33.0% ➖ noise
14 duckdb:vortex-compact -1.8% +24.9% -21.3% +32.1% ➖ noise
14 duckdb:vortex-file-compressed +6.0% +24.9% -15.1% +30.3% ➖ noise
15 datafusion:vortex-compact +65.1% +19.9% +37.6% +30.0% 🚨 regression
15 datafusion:vortex-file-compressed +30.8% +19.9% +9.1% +31.0% ➖ noise
15 duckdb:vortex-compact +1.2% +19.9% -15.6% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +14.8% +19.9% -4.2% +30.0% ➖ noise
16 datafusion:vortex-compact +19.3% +21.8% -2.1% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +24.9% +21.8% +2.6% +32.7% ➖ noise
16 duckdb:vortex-compact -18.8% +21.8% -33.3% +30.0% ✅ faster
16 duckdb:vortex-file-compressed +8.1% +21.8% -11.3% +30.0% ➖ noise
17 datafusion:vortex-compact +40.9% +12.7% +25.0% +30.6% ➖ noise
17 datafusion:vortex-file-compressed +75.5% +12.7% +55.8% +33.9% 🚨 regression
17 duckdb:vortex-compact -13.9% +12.7% -23.6% +30.0% ✅ faster
17 duckdb:vortex-file-compressed -7.0% +12.7% -17.5% +30.0% ➖ noise
18 datafusion:vortex-compact +67.2% +11.7% +49.8% +30.0% 🚨 regression
18 datafusion:vortex-file-compressed +28.6% +11.7% +15.2% +37.4% ➖ noise
18 duckdb:vortex-compact +11.5% +11.7% -0.2% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -8.6% +11.7% -18.1% +30.0% ➖ noise
19 datafusion:vortex-compact +56.4% +35.8% +15.2% +31.8% ➖ noise
19 datafusion:vortex-file-compressed +32.9% +35.8% -2.2% +34.1% ➖ noise
19 duckdb:vortex-compact +12.3% +35.8% -17.3% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -6.7% +35.8% -31.3% +30.0% ✅ faster
20 datafusion:vortex-compact +50.7% +21.4% +24.1% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +4.1% +21.4% -14.2% +30.0% ➖ noise
20 duckdb:vortex-compact +9.8% +21.4% -9.6% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +9.4% +21.4% -9.9% +30.0% ➖ noise
21 datafusion:vortex-compact -1.3% +18.3% -16.6% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +13.5% +18.3% -4.1% +30.0% ➖ noise
21 duckdb:vortex-compact +1.8% +18.3% -13.9% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +3.9% +18.3% -12.2% +30.0% ➖ noise
22 datafusion:vortex-compact +25.2% +34.9% -7.2% +30.2% ➖ noise
22 datafusion:vortex-file-compressed -9.1% +34.9% -32.6% +31.1% ✅ faster
22 duckdb:vortex-compact -12.0% +34.9% -34.8% +30.0% ✅ faster
22 duckdb:vortex-file-compressed -0.5% +34.9% -26.3% +30.0% ✅ faster

@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.7%, low confidence) · DuckDB No clear signal (+0.0%, low confidence)
Vortex (geomean): 1.022x ➖
Parquet (geomean): 1.022x ➖
Shifts: Parquet (control) +2.2% · Median polish +3.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.001x ➖, 1↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 🚀 127168703 141761463 0.90
appian_q02/datafusion:vortex-file-compressed 681498285 676857269 1.01
appian_q03/datafusion:vortex-file-compressed 378073634 381997645 0.99
appian_q04/datafusion:vortex-file-compressed 29367031376 28248786397 1.04
appian_q05/datafusion:vortex-file-compressed 291370353 277069102 1.05
appian_q06/datafusion:vortex-file-compressed 454075315 433463540 1.05
appian_q07/datafusion:vortex-file-compressed 484188693 465601469 1.04
appian_q08/datafusion:vortex-file-compressed 1986524183 2099423338 0.95
datafusion / parquet (1.008x ➖, 0↑ 1↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 147872844 145635373 1.02
appian_q02/datafusion:parquet 741350572 721158018 1.03
appian_q03/datafusion:parquet 373387308 385998361 0.97
appian_q04/datafusion:parquet 28040509239 28797979626 0.97
appian_q05/datafusion:parquet 290911126 298768700 0.97
appian_q06/datafusion:parquet 438458735 440048402 1.00
appian_q07/datafusion:parquet 473265187 471071429 1.00
appian_q08/datafusion:parquet 🚨 2105784812 1895509342 1.11
duckdb / vortex-file-compressed (1.043x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 202639978 191897230 1.06
appian_q02/duckdb:vortex-file-compressed 631884325 609098993 1.04
appian_q03/duckdb:vortex-file-compressed 275001716 259411249 1.06
appian_q04/duckdb:vortex-file-compressed 1369377412 1336287405 1.02
appian_q05/duckdb:vortex-file-compressed 302476791 290848394 1.04
appian_q06/duckdb:vortex-file-compressed 815897297 808447827 1.01
appian_q07/duckdb:vortex-file-compressed 360763202 339419357 1.06
appian_q08/duckdb:vortex-file-compressed 1367169586 1299443531 1.05
duckdb / parquet (1.036x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 219008175 203204768 1.08
appian_q02/duckdb:parquet 620634927 608921836 1.02
appian_q03/duckdb:parquet 300729343 285016939 1.06
appian_q04/duckdb:parquet 1350346298 1324220034 1.02
appian_q05/duckdb:parquet 327840581 311642711 1.05
appian_q06/duckdb:parquet 801233922 799982147 1.00
appian_q07/duckdb:parquet 374226996 362925484 1.03
appian_q08/duckdb:parquet 1318760336 1272040290 1.04
duckdb / duckdb (1.030x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 178185942 171271975 1.04
appian_q02/duckdb:duckdb 564427172 550533648 1.03
appian_q03/duckdb:duckdb 406951760 395217794 1.03
appian_q04/duckdb:duckdb 1341956920 1310596557 1.02
appian_q05/duckdb:duckdb 297967699 283066106 1.05
appian_q06/duckdb:duckdb 793428164 794938884 1.00
appian_q07/duckdb:duckdb 338081633 325297147 1.04
appian_q08/duckdb:duckdb 1260853788 1218017251 1.04
File Size Changes (4 files changed, -0.0% overall, 2↑ 2↓)
File Scale Format Base HEAD Change %
creditcardview.vortex 1.0 vortex-file-compressed 60.97 MB 61.03 MB +61.44 KB +0.1%
orderview.vortex 1.0 vortex-file-compressed 81.05 MB 81.10 MB +49.73 KB +0.1%
addressview.vortex 1.0 vortex-file-compressed 34.62 MB 34.62 MB 32 B -0.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 513.64 MB → 513.75 MB (+0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-file-compressed -10.3% +4.6% -14.2% +18.9% ➖ noise
1 duckdb:duckdb +4.0% +4.6% -0.5% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +5.6% +4.6% +0.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.7% +2.4% -1.6% +10.0% ➖ noise
2 duckdb:duckdb +2.5% +2.4% +0.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +3.7% +2.4% +1.3% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.0% +1.0% -2.0% +10.0% ➖ noise
3 duckdb:duckdb +3.0% +1.0% +1.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +6.0% +1.0% +4.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +4.0% -0.4% +4.3% +10.0% ➖ noise
4 duckdb:duckdb +2.4% -0.4% +2.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.5% -0.4% +2.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +5.2% +1.2% +3.9% +12.5% ➖ noise
5 duckdb:duckdb +5.3% +1.2% +4.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +4.0% +1.2% +2.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +4.8% -0.1% +4.9% +10.0% ➖ noise
6 duckdb:duckdb -0.2% -0.1% -0.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.9% -0.1% +1.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +4.0% +1.8% +2.2% +10.0% ➖ noise
7 duckdb:duckdb +3.9% +1.8% +2.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +6.3% +1.8% +4.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -5.4% +7.3% -11.8% +10.0% ✅ faster
8 duckdb:duckdb +3.5% +7.3% -3.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +5.2% +7.3% -2.0% +10.0% ➖ noise

@myrrc
initial
6c1444c 
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc myrrc force-pushed the myrrc/chunked-layout-offsets branch from ee43336 to 6c1444c Compare June 3, 2026 11:29
@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+3.6%, environment too noisy confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): 1.071x ➖
Parquet (geomean): 1.032x ➖
Shifts: Parquet (control) +3.2% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (1.101x ❌, 0↑ 19↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 2073687 1681834 1.23
clickbench_q01/datafusion:vortex-file-compressed 🚨 19487705 16778404 1.16
clickbench_q02/datafusion:vortex-file-compressed 🚨 43095150 35993952 1.20
clickbench_q03/datafusion:vortex-file-compressed 🚨 50764899 41546669 1.22
clickbench_q04/datafusion:vortex-file-compressed 🚨 340100712 280617208 1.21
clickbench_q05/datafusion:vortex-file-compressed 🚨 384878145 323870507 1.19
clickbench_q06/datafusion:vortex-file-compressed 2121146 1949158 1.09
clickbench_q07/datafusion:vortex-file-compressed 🚨 23900651 19980426 1.20
clickbench_q08/datafusion:vortex-file-compressed 🚨 424552663 342959153 1.24
clickbench_q09/datafusion:vortex-file-compressed 🚨 648892728 551087746 1.18
clickbench_q10/datafusion:vortex-file-compressed 🚨 86225467 74055968 1.16
clickbench_q11/datafusion:vortex-file-compressed 🚨 95340921 86505896 1.10
clickbench_q12/datafusion:vortex-file-compressed 🚨 322000315 290451717 1.11
clickbench_q13/datafusion:vortex-file-compressed 🚨 516422794 430009490 1.20
clickbench_q14/datafusion:vortex-file-compressed 🚨 318973571 274735211 1.16
clickbench_q15/datafusion:vortex-file-compressed 🚨 373921457 319052454 1.17
clickbench_q16/datafusion:vortex-file-compressed 🚨 789463714 672292690 1.17
clickbench_q17/datafusion:vortex-file-compressed 🚨 754482495 646993024 1.17
clickbench_q18/datafusion:vortex-file-compressed 🚨 1702105186 1363508873 1.25
clickbench_q19/datafusion:vortex-file-compressed 35157127 32820305 1.07
clickbench_q20/datafusion:vortex-file-compressed 🚨 369402792 324049210 1.14
clickbench_q21/datafusion:vortex-file-compressed 424928410 416126363 1.02
clickbench_q22/datafusion:vortex-file-compressed 541950274 513332142 1.06
clickbench_q23/datafusion:vortex-file-compressed 565493314 552612163 1.02
clickbench_q24/datafusion:vortex-file-compressed 49559427 49620502 1.00
clickbench_q25/datafusion:vortex-file-compressed 85788757 79296754 1.08
clickbench_q26/datafusion:vortex-file-compressed 49635599 49734285 1.00
clickbench_q27/datafusion:vortex-file-compressed 803281858 760316320 1.06
clickbench_q28/datafusion:vortex-file-compressed 6039199938 5754789595 1.05
clickbench_q29/datafusion:vortex-file-compressed 230786023 219294187 1.05
clickbench_q30/datafusion:vortex-file-compressed 256413518 246415019 1.04
clickbench_q31/datafusion:vortex-file-compressed 299019706 289197441 1.03
clickbench_q32/datafusion:vortex-file-compressed 1184725247 1115061751 1.06
clickbench_q33/datafusion:vortex-file-compressed 1457380201 1361338156 1.07
clickbench_q34/datafusion:vortex-file-compressed 1374001033 1362406030 1.01
clickbench_q35/datafusion:vortex-file-compressed 457398359 439049630 1.04
clickbench_q36/datafusion:vortex-file-compressed 73123242 75384329 0.97
clickbench_q37/datafusion:vortex-file-compressed 37892636 34734235 1.09
clickbench_q38/datafusion:vortex-file-compressed 21009000 19984875 1.05
clickbench_q39/datafusion:vortex-file-compressed 139533028 136729149 1.02
clickbench_q40/datafusion:vortex-file-compressed 16467159 15922875 1.03
clickbench_q41/datafusion:vortex-file-compressed 15415852 14881075 1.04
clickbench_q42/datafusion:vortex-file-compressed 17620318 16640556 1.06
datafusion / parquet (1.063x ➖, 0↑ 15↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1564536 1539829 1.02
clickbench_q01/datafusion:parquet 19252378 20310223 0.95
clickbench_q02/datafusion:parquet 46527286 47535564 0.98
clickbench_q03/datafusion:parquet 37842435 39067063 0.97
clickbench_q04/datafusion:parquet 294937047 304008426 0.97
clickbench_q05/datafusion:parquet 358108392 342829041 1.04
clickbench_q06/datafusion:parquet 1576369 1565962 1.01
clickbench_q07/datafusion:parquet 22423007 22344821 1.00
clickbench_q08/datafusion:parquet 375018747 365018105 1.03
clickbench_q09/datafusion:parquet 608947642 619346480 0.98
clickbench_q10/datafusion:parquet 106101174 106196820 1.00
clickbench_q11/datafusion:parquet 129586973 131078750 0.99
clickbench_q12/datafusion:parquet 344998775 341857983 1.01
clickbench_q13/datafusion:parquet 489612521 502929378 0.97
clickbench_q14/datafusion:parquet 343409584 340860138 1.01
clickbench_q15/datafusion:parquet 335368710 338327932 0.99
clickbench_q16/datafusion:parquet 671157879 665751739 1.01
clickbench_q17/datafusion:parquet 636044937 649607212 0.98
clickbench_q18/datafusion:parquet 1368276623 1407594474 0.97
clickbench_q19/datafusion:parquet 29437898 30850189 0.95
clickbench_q20/datafusion:parquet 613851282 592268489 1.04
clickbench_q21/datafusion:parquet 661203813 655530965 1.01
clickbench_q22/datafusion:parquet 976933385 966424402 1.01
clickbench_q23/datafusion:parquet 🚨 4285046655 3655149337 1.17
clickbench_q24/datafusion:parquet 86146295 81134430 1.06
clickbench_q25/datafusion:parquet 145401134 132619431 1.10
clickbench_q26/datafusion:parquet 86230461 81358921 1.06
clickbench_q27/datafusion:parquet 1146493175 1071403143 1.07
clickbench_q28/datafusion:parquet 🚨 7270537641 6557233919 1.11
clickbench_q29/datafusion:parquet 🚨 256983644 233152538 1.10
clickbench_q30/datafusion:parquet 🚨 409381394 326854785 1.25
clickbench_q31/datafusion:parquet 🚨 431810551 366718087 1.18
clickbench_q32/datafusion:parquet 🚨 1448228654 1188705676 1.22
clickbench_q33/datafusion:parquet 🚨 1815150276 1474415475 1.23
clickbench_q34/datafusion:parquet 🚨 1810734188 1528251823 1.18
clickbench_q35/datafusion:parquet 🚨 568815963 472457661 1.20
clickbench_q36/datafusion:parquet 🚨 174083416 146507014 1.19
clickbench_q37/datafusion:parquet 🚨 66073143 57706482 1.14
clickbench_q38/datafusion:parquet 🚨 97900764 87862263 1.11
clickbench_q39/datafusion:parquet 🚨 302104245 264985362 1.14
clickbench_q40/datafusion:parquet 🚨 35867655 30167572 1.19
clickbench_q41/datafusion:parquet 🚨 30993288 26651787 1.16
clickbench_q42/datafusion:parquet 31986249 29392002 1.09
duckdb / vortex-file-compressed (1.041x ➖, 0↑ 7↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6272309 6224289 1.01
clickbench_q01/duckdb:vortex-file-compressed 11348890 10781983 1.05
clickbench_q02/duckdb:vortex-file-compressed 25733952 26302495 0.98
clickbench_q03/duckdb:vortex-file-compressed 30062868 30920728 0.97
clickbench_q04/duckdb:vortex-file-compressed 185510868 186456352 0.99
clickbench_q05/duckdb:vortex-file-compressed 177599727 180263490 0.99
clickbench_q06/duckdb:vortex-file-compressed 20478481 20206473 1.01
clickbench_q07/duckdb:vortex-file-compressed 14538517 14325665 1.01
clickbench_q08/duckdb:vortex-file-compressed 263202686 264650815 0.99
clickbench_q09/duckdb:vortex-file-compressed 340023496 337467547 1.01
clickbench_q10/duckdb:vortex-file-compressed 68350850 67927788 1.01
clickbench_q11/duckdb:vortex-file-compressed 79730957 77250571 1.03
clickbench_q12/duckdb:vortex-file-compressed 204530682 200716591 1.02
clickbench_q13/duckdb:vortex-file-compressed 417670289 406706394 1.03
clickbench_q14/duckdb:vortex-file-compressed 235674043 235524786 1.00
clickbench_q15/duckdb:vortex-file-compressed 244600960 243325346 1.01
clickbench_q16/duckdb:vortex-file-compressed 536130328 523320457 1.02
clickbench_q17/duckdb:vortex-file-compressed 426746898 426099301 1.00
clickbench_q18/duckdb:vortex-file-compressed 957261453 940999270 1.02
clickbench_q19/duckdb:vortex-file-compressed 22868847 21370171 1.07
clickbench_q20/duckdb:vortex-file-compressed 305423690 317431332 0.96
clickbench_q21/duckdb:vortex-file-compressed 406379096 399511940 1.02
clickbench_q22/duckdb:vortex-file-compressed 583020175 570814307 1.02
clickbench_q23/duckdb:vortex-file-compressed 197399813 179844311 1.10
clickbench_q24/duckdb:vortex-file-compressed 🚨 49461247 43768475 1.13
clickbench_q25/duckdb:vortex-file-compressed 82276166 83671862 0.98
clickbench_q26/duckdb:vortex-file-compressed 47534564 46609894 1.02
clickbench_q27/duckdb:vortex-file-compressed 513521207 521615068 0.98
clickbench_q28/duckdb:vortex-file-compressed 3050266499 3071105374 0.99
clickbench_q29/duckdb:vortex-file-compressed 27930233 29624042 0.94
clickbench_q30/duckdb:vortex-file-compressed 216659706 210237243 1.03
clickbench_q31/duckdb:vortex-file-compressed 314135237 311168317 1.01
clickbench_q32/duckdb:vortex-file-compressed 1129147738 1123197888 1.01
clickbench_q33/duckdb:vortex-file-compressed 1121639152 1113344771 1.01
clickbench_q34/duckdb:vortex-file-compressed 1204921482 1210307438 1.00
clickbench_q35/duckdb:vortex-file-compressed 372542240 378762869 0.98
clickbench_q36/duckdb:vortex-file-compressed 🚨 29509723 24072252 1.23
clickbench_q37/duckdb:vortex-file-compressed 🚨 21226031 17071738 1.24
clickbench_q38/duckdb:vortex-file-compressed 🚨 23562265 18855608 1.25
clickbench_q39/duckdb:vortex-file-compressed 44314152 40333251 1.10
clickbench_q40/duckdb:vortex-file-compressed 🚨 21532968 16414413 1.31
clickbench_q41/duckdb:vortex-file-compressed 🚨 19919559 16751498 1.19
clickbench_q42/duckdb:vortex-file-compressed 🚨 23438910 19777416 1.19
duckdb / parquet (1.001x ➖, 0↑ 1↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23065725 23416162 0.99
clickbench_q01/duckdb:parquet 🚨 31871497 28465924 1.12
clickbench_q02/duckdb:parquet 50152870 50376383 1.00
clickbench_q03/duckdb:parquet 39473274 39907447 0.99
clickbench_q04/duckdb:parquet 205792441 200592341 1.03
clickbench_q05/duckdb:parquet 262416714 257939608 1.02
clickbench_q06/duckdb:parquet 47677466 47499783 1.00
clickbench_q07/duckdb:parquet 31177117 31386602 0.99
clickbench_q08/duckdb:parquet 270866802 268994216 1.01
clickbench_q09/duckdb:parquet 404223706 399007960 1.01
clickbench_q10/duckdb:parquet 82865412 83235761 1.00
clickbench_q11/duckdb:parquet 101281193 100309665 1.01
clickbench_q12/duckdb:parquet 281887047 282704213 1.00
clickbench_q13/duckdb:parquet 475658291 474379887 1.00
clickbench_q14/duckdb:parquet 314001727 314547918 1.00
clickbench_q15/duckdb:parquet 256551084 256183809 1.00
clickbench_q16/duckdb:parquet 595295615 596063523 1.00
clickbench_q17/duckdb:parquet 504575774 501023076 1.01
clickbench_q18/duckdb:parquet 1041171911 1030785654 1.01
clickbench_q19/duckdb:parquet 27948083 27936571 1.00
clickbench_q20/duckdb:parquet 421047850 420645372 1.00
clickbench_q21/duckdb:parquet 531565979 535445468 0.99
clickbench_q22/duckdb:parquet 911662497 924332022 0.99
clickbench_q23/duckdb:parquet 267608550 261917317 1.02
clickbench_q24/duckdb:parquet 72778172 70515196 1.03
clickbench_q25/duckdb:parquet 163179251 162162311 1.01
clickbench_q26/duckdb:parquet 53504576 56076325 0.95
clickbench_q27/duckdb:parquet 638935275 637559300 1.00
clickbench_q28/duckdb:parquet 4895190855 4883113355 1.00
clickbench_q29/duckdb:parquet 42043584 41712573 1.01
clickbench_q30/duckdb:parquet 311325529 311916907 1.00
clickbench_q31/duckdb:parquet 373793430 374281927 1.00
clickbench_q32/duckdb:parquet 1120976770 1102572716 1.02
clickbench_q33/duckdb:parquet 1104129825 1097895904 1.01
clickbench_q34/duckdb:parquet 1157663513 1151931302 1.00
clickbench_q35/duckdb:parquet 374240016 369358190 1.01
clickbench_q36/duckdb:parquet 46745583 48295018 0.97
clickbench_q37/duckdb:parquet 35371333 35361681 1.00
clickbench_q38/duckdb:parquet 36356943 39840260 0.91
clickbench_q39/duckdb:parquet 84373096 86167665 0.98
clickbench_q40/duckdb:parquet 20025507 20528970 0.98
clickbench_q41/duckdb:parquet 20599534 20655229 1.00
clickbench_q42/duckdb:parquet 22025996 21697107 1.02
duckdb / duckdb (0.961x ➖, 8↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚀 17562818 21590146 0.81
clickbench_q01/duckdb:duckdb 🚀 34258965 38935563 0.88
clickbench_q02/duckdb:duckdb 51545677 56437281 0.91
clickbench_q03/duckdb:duckdb 56230272 58931790 0.95
clickbench_q04/duckdb:duckdb 210347534 225059523 0.93
clickbench_q05/duckdb:duckdb 283962797 297713951 0.95
clickbench_q06/duckdb:duckdb 🚀 34673556 39225287 0.88
clickbench_q07/duckdb:duckdb 🚀 35269242 39782897 0.89
clickbench_q08/duckdb:duckdb 277492939 289449492 0.96
clickbench_q09/duckdb:duckdb 394128781 395318748 1.00
clickbench_q10/duckdb:duckdb 117272653 119496803 0.98
clickbench_q11/duckdb:duckdb 127191414 129325636 0.98
clickbench_q12/duckdb:duckdb 259058820 262085545 0.99
clickbench_q13/duckdb:duckdb 442096925 445440660 0.99
clickbench_q14/duckdb:duckdb 285117346 287950775 0.99
clickbench_q15/duckdb:duckdb 241899770 245808744 0.98
clickbench_q16/duckdb:duckdb 561932047 559273722 1.00
clickbench_q17/duckdb:duckdb 472501888 472625385 1.00
clickbench_q18/duckdb:duckdb 999808637 988993226 1.01
clickbench_q19/duckdb:duckdb 34514891 37703827 0.92
clickbench_q20/duckdb:duckdb 473084370 455911006 1.04
clickbench_q21/duckdb:duckdb 488109883 468968308 1.04
clickbench_q22/duckdb:duckdb 529548111 538082196 0.98
clickbench_q23/duckdb:duckdb 263309839 250732019 1.05
clickbench_q24/duckdb:duckdb 61457542 63949907 0.96
clickbench_q25/duckdb:duckdb 150698473 151900086 0.99
clickbench_q26/duckdb:duckdb 61842354 63995218 0.97
clickbench_q27/duckdb:duckdb 565993254 550123285 1.03
clickbench_q28/duckdb:duckdb 4515089140 4502922290 1.00
clickbench_q29/duckdb:duckdb 50444626 54086441 0.93
clickbench_q30/duckdb:duckdb 276600658 283460203 0.98
clickbench_q31/duckdb:duckdb 362328155 372215614 0.97
clickbench_q32/duckdb:duckdb 1108806475 1110344149 1.00
clickbench_q33/duckdb:duckdb 1138373747 1098030387 1.04
clickbench_q34/duckdb:duckdb 1207396966 1181369460 1.02
clickbench_q35/duckdb:duckdb 299481550 301263568 0.99
clickbench_q36/duckdb:duckdb 48895837 53474243 0.91
clickbench_q37/duckdb:duckdb 🚀 28935847 32169788 0.90
clickbench_q38/duckdb:duckdb 34398680 36949759 0.93
clickbench_q39/duckdb:duckdb 🚀 78558486 87539596 0.90
clickbench_q40/duckdb:duckdb 🚀 28044803 31591157 0.89
clickbench_q41/duckdb:duckdb 🚀 27465892 30529609 0.90
clickbench_q42/duckdb:duckdb 30690975 32886741 0.93
File Size Changes (103 files changed, -0.0% overall, 41↑ 62↓)
File Scale Format Base HEAD Change %
hits_37.vortex 1.0 vortex-file-compressed 85.86 MB 86.05 MB +198.39 KB +0.2%
hits_73.vortex 1.0 vortex-file-compressed 110.42 MB 110.64 MB +232.57 KB +0.2%
hits_29.vortex 1.0 vortex-compact 36.50 MB 36.57 MB +76.70 KB +0.2%
hits_57.vortex 1.0 vortex-file-compressed 128.23 MB 128.49 MB +260.80 KB +0.2%
hits_88.vortex 1.0 vortex-file-compressed 111.36 MB 111.57 MB +216.52 KB +0.2%
hits_64.vortex 1.0 vortex-file-compressed 81.26 MB 81.40 MB +139.51 KB +0.2%
hits_19.vortex 1.0 vortex-file-compressed 73.60 MB 73.70 MB +107.73 KB +0.1%
hits_77.vortex 1.0 vortex-file-compressed 168.56 MB 168.76 MB +211.36 KB +0.1%
hits_30.vortex 1.0 vortex-file-compressed 87.14 MB 87.24 MB +105.62 KB +0.1%
hits_99.vortex 1.0 vortex-file-compressed 123.11 MB 123.25 MB +145.23 KB +0.1%
hits_97.vortex 1.0 vortex-compact 68.98 MB 69.04 MB +60.21 KB +0.1%
hits_10.vortex 1.0 vortex-file-compressed 69.70 MB 69.74 MB +48.19 KB +0.1%
hits_85.vortex 1.0 vortex-file-compressed 91.85 MB 91.91 MB +63.09 KB +0.1%
hits_82.vortex 1.0 vortex-file-compressed 99.83 MB 99.88 MB +58.20 KB +0.1%
hits_81.vortex 1.0 vortex-file-compressed 100.78 MB 100.84 MB +55.74 KB +0.1%
hits_4.vortex 1.0 vortex-file-compressed 108.66 MB 108.72 MB +59.17 KB +0.1%
hits_27.vortex 1.0 vortex-file-compressed 122.34 MB 122.40 MB +64.45 KB +0.1%
hits_8.vortex 1.0 vortex-file-compressed 93.20 MB 93.25 MB +48.84 KB +0.1%
hits_74.vortex 1.0 vortex-file-compressed 119.84 MB 119.90 MB +60.30 KB +0.0%
hits_15.vortex 1.0 vortex-file-compressed 89.31 MB 89.35 MB +43.84 KB +0.0%
hits_90.vortex 1.0 vortex-file-compressed 142.06 MB 142.13 MB +68.70 KB +0.0%
hits_32.vortex 1.0 vortex-file-compressed 66.85 MB 66.88 MB +28.66 KB +0.0%
hits_59.vortex 1.0 vortex-file-compressed 101.85 MB 101.89 MB +43.40 KB +0.0%
hits_1.vortex 1.0 vortex-file-compressed 138.45 MB 138.50 MB +56.55 KB +0.0%
hits_25.vortex 1.0 vortex-file-compressed 113.81 MB 113.85 MB +43.62 KB +0.0%
hits_61.vortex 1.0 vortex-file-compressed 101.32 MB 101.35 MB +35.72 KB +0.0%
hits_20.vortex 1.0 vortex-file-compressed 62.96 MB 62.98 MB +21.88 KB +0.0%
hits_98.vortex 1.0 vortex-file-compressed 118.42 MB 118.45 MB +31.66 KB +0.0%
hits_21.vortex 1.0 vortex-file-compressed 93.97 MB 93.99 MB +24.10 KB +0.0%
hits_69.vortex 1.0 vortex-file-compressed 123.09 MB 123.12 MB +29.26 KB +0.0%
hits_42.vortex 1.0 vortex-file-compressed 223.26 MB 223.30 MB +46.12 KB +0.0%
hits_46.vortex 1.0 vortex-file-compressed 69.44 MB 69.46 MB +13.05 KB +0.0%
hits_80.vortex 1.0 vortex-file-compressed 104.98 MB 104.99 MB +14.60 KB +0.0%
hits_2.vortex 1.0 vortex-file-compressed 186.50 MB 186.52 MB +19.55 KB +0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.62 MB 277.65 MB +27.31 KB +0.0%
hits_12.vortex 1.0 vortex-file-compressed 101.12 MB 101.13 MB +7.48 KB +0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.89 MB 146.90 MB +8.07 KB +0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.40 MB 221.42 MB +12.05 KB +0.0%
hits_94.vortex 1.0 vortex-file-compressed 138.72 MB 138.72 MB +6.35 KB +0.0%
hits_95.vortex 1.0 vortex-file-compressed 96.56 MB 96.56 MB +2.62 KB +0.0%
hits_38.vortex 1.0 vortex-file-compressed 99.26 MB 99.27 MB +1.66 KB +0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.32 MB 41.32 MB 696 B -0.0%
hits_65.vortex 1.0 vortex-file-compressed 183.84 MB 183.83 MB 9.19 KB -0.0%
hits_23.vortex 1.0 vortex-file-compressed 77.96 MB 77.95 MB 4.77 KB -0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.74 MB 135.73 MB 9.27 KB -0.0%
hits_41.vortex 1.0 vortex-file-compressed 224.17 MB 224.14 MB 28.24 KB -0.0%
hits_66.vortex 1.0 vortex-file-compressed 90.27 MB 90.26 MB 13.91 KB -0.0%
hits_31.vortex 1.0 vortex-file-compressed 90.18 MB 90.17 MB 14.25 KB -0.0%
hits_29.vortex 1.0 vortex-file-compressed 59.82 MB 59.82 MB 9.65 KB -0.0%
hits_35.vortex 1.0 vortex-file-compressed 115.12 MB 115.10 MB 18.82 KB -0.0%
hits_34.vortex 1.0 vortex-file-compressed 97.82 MB 97.80 MB 16.91 KB -0.0%
hits_0.vortex 1.0 vortex-file-compressed 89.68 MB 89.66 MB 18.28 KB -0.0%
hits_22.vortex 1.0 vortex-file-compressed 78.58 MB 78.56 MB 17.15 KB -0.0%
hits_33.vortex 1.0 vortex-file-compressed 57.29 MB 57.27 MB 12.52 KB -0.0%
hits_17.vortex 1.0 vortex-file-compressed 87.46 MB 87.44 MB 19.63 KB -0.0%
hits_91.vortex 1.0 vortex-file-compressed 97.25 MB 97.23 MB 22.11 KB -0.0%
hits_24.vortex 1.0 vortex-file-compressed 77.47 MB 77.46 MB 18.77 KB -0.0%
hits_87.vortex 1.0 vortex-file-compressed 172.65 MB 172.60 MB 44.53 KB -0.0%
hits_63.vortex 1.0 vortex-file-compressed 69.35 MB 69.33 MB 18.73 KB -0.0%
hits_70.vortex 1.0 vortex-file-compressed 93.69 MB 93.66 MB 25.49 KB -0.0%
hits_11.vortex 1.0 vortex-file-compressed 80.00 MB 79.98 MB 23.06 KB -0.0%
hits_68.vortex 1.0 vortex-file-compressed 123.46 MB 123.42 MB 39.49 KB -0.0%
hits_28.vortex 1.0 vortex-file-compressed 119.88 MB 119.84 MB 39.77 KB -0.0%
hits_75.vortex 1.0 vortex-file-compressed 63.35 MB 63.33 MB 21.02 KB -0.0%
hits_26.vortex 1.0 vortex-file-compressed 110.06 MB 110.03 MB 36.57 KB -0.0%
hits_89.vortex 1.0 vortex-file-compressed 184.56 MB 184.50 MB 65.31 KB -0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.04 MB 28.03 MB 10.48 KB -0.0%
hits_40.vortex 1.0 vortex-file-compressed 117.91 MB 117.86 MB 46.14 KB -0.0%
hits_60.vortex 1.0 vortex-file-compressed 103.43 MB 103.39 MB 41.46 KB -0.0%
hits_93.vortex 1.0 vortex-file-compressed 90.66 MB 90.62 MB 42.63 KB -0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.38 MB 164.30 MB 77.98 KB -0.0%
hits_14.vortex 1.0 vortex-file-compressed 111.39 MB 111.33 MB 55.57 KB -0.0%
hits_13.vortex 1.0 vortex-file-compressed 99.38 MB 99.33 MB 49.72 KB -0.0%
hits_83.vortex 1.0 vortex-file-compressed 89.92 MB 89.87 MB 49.56 KB -0.1%
hits_5.vortex 1.0 vortex-file-compressed 93.02 MB 92.97 MB 54.13 KB -0.1%
hits_52.vortex 1.0 vortex-file-compressed 105.15 MB 105.09 MB 61.20 KB -0.1%
hits_76.vortex 1.0 vortex-file-compressed 114.57 MB 114.50 MB 67.38 KB -0.1%
hits_50.vortex 1.0 vortex-file-compressed 179.35 MB 179.24 MB 113.23 KB -0.1%
hits_45.vortex 1.0 vortex-file-compressed 122.13 MB 122.05 MB 78.29 KB -0.1%
hits_3.vortex 1.0 vortex-file-compressed 142.32 MB 142.23 MB 91.31 KB -0.1%
hits_39.vortex 1.0 vortex-file-compressed 80.41 MB 80.36 MB 52.16 KB -0.1%
hits_44.vortex 1.0 vortex-file-compressed 187.04 MB 186.90 MB 137.53 KB -0.1%
hits_6.vortex 1.0 vortex-file-compressed 93.44 MB 93.37 MB 70.10 KB -0.1%
hits_58.vortex 1.0 vortex-file-compressed 90.51 MB 90.45 MB 68.73 KB -0.1%
hits_43.vortex 1.0 vortex-file-compressed 227.45 MB 227.28 MB 176.43 KB -0.1%
hits_72.vortex 1.0 vortex-file-compressed 84.89 MB 84.82 MB 71.87 KB -0.1%
hits_18.vortex 1.0 vortex-file-compressed 104.87 MB 104.78 MB 90.04 KB -0.1%
hits_86.vortex 1.0 vortex-file-compressed 69.44 MB 69.38 MB 62.88 KB -0.1%
hits_67.vortex 1.0 vortex-file-compressed 184.26 MB 184.10 MB 168.34 KB -0.1%
hits_71.vortex 1.0 vortex-file-compressed 102.17 MB 102.08 MB 93.36 KB -0.1%
hits_36.vortex 1.0 vortex-file-compressed 68.51 MB 68.43 MB 81.05 KB -0.1%
hits_56.vortex 1.0 vortex-file-compressed 123.67 MB 123.51 MB 159.90 KB -0.1%
hits_7.vortex 1.0 vortex-file-compressed 94.05 MB 93.92 MB 133.33 KB -0.1%
hits_9.vortex 1.0 vortex-file-compressed 99.34 MB 99.20 MB 141.62 KB -0.1%
hits_79.vortex 1.0 vortex-file-compressed 145.29 MB 145.06 MB 230.25 KB -0.2%
hits_16.vortex 1.0 vortex-file-compressed 80.23 MB 80.08 MB 159.71 KB -0.2%
hits_84.vortex 1.0 vortex-file-compressed 117.56 MB 117.31 MB 246.62 KB -0.2%
hits_97.vortex 1.0 vortex-file-compressed 107.30 MB 107.07 MB 239.34 KB -0.2%
hits_49.vortex 1.0 vortex-file-compressed 76.07 MB 75.85 MB 228.23 KB -0.3%
hits_62.vortex 1.0 vortex-file-compressed 117.64 MB 117.28 MB 368.81 KB -0.3%
hits_53.vortex 1.0 vortex-file-compressed 87.71 MB 87.30 MB 428.17 KB -0.5%
hits_55.vortex 1.0 vortex-file-compressed 169.33 MB 166.67 MB 2.65 MB -1.6%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.04 GB → 7.04 GB (-0.0%)
  • vortex-file-compressed: 11.02 GB → 11.02 GB (-0.0%)
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +23.3% +0.0% +23.2% +793.1% ➖ noise
0 duckdb:duckdb -18.7% +0.0% -18.7% +273.6% ➖ noise
0 duckdb:vortex-file-compressed +0.8% +0.0% +0.7% +464.6% ➖ noise
1 datafusion:vortex-file-compressed +16.1% +3.0% +12.7% +26.4% ➖ noise
1 duckdb:duckdb -12.0% +3.0% -14.6% +52.9% ➖ noise
1 duckdb:vortex-file-compressed +5.3% +3.0% +2.2% +26.8% ➖ noise
2 datafusion:vortex-file-compressed +19.7% -1.3% +21.3% +26.8% ➖ noise
2 duckdb:duckdb -8.7% -1.3% -7.5% +25.7% ➖ noise
2 duckdb:vortex-file-compressed -2.2% -1.3% -0.9% +11.0% ➖ noise
3 datafusion:vortex-file-compressed +22.2% -2.1% +24.8% +143.4% ➖ noise
3 duckdb:duckdb -4.6% -2.1% -2.5% +60.6% ➖ noise
3 duckdb:vortex-file-compressed -2.8% -2.1% -0.7% +81.5% ➖ noise
4 datafusion:vortex-file-compressed +21.2% -0.2% +21.5% +10.9% 🚨 regression
4 duckdb:duckdb -6.5% -0.2% -6.3% +10.9% ➖ noise
4 duckdb:vortex-file-compressed -0.5% -0.2% -0.3% +10.9% ➖ noise
5 datafusion:vortex-file-compressed +18.8% +3.1% +15.3% +10.9% 🚨 regression
5 duckdb:duckdb -4.6% +3.1% -7.5% +10.9% ➖ noise
5 duckdb:vortex-file-compressed -1.5% +3.1% -4.4% +10.9% ➖ noise
6 datafusion:vortex-file-compressed +8.8% +0.5% +8.3% +51.7% ➖ noise
6 duckdb:duckdb -11.6% +0.5% -12.1% +15.2% ➖ noise
6 duckdb:vortex-file-compressed +1.3% +0.5% +0.8% +20.6% ➖ noise
7 datafusion:vortex-file-compressed +19.6% -0.2% +19.8% +33.0% ➖ noise
7 duckdb:duckdb -11.3% -0.2% -11.2% +10.9% ✅ faster
7 duckdb:vortex-file-compressed +1.5% -0.2% +1.6% +41.4% ➖ noise
8 datafusion:vortex-file-compressed +23.8% +1.7% +21.7% +10.9% 🚨 regression
8 duckdb:duckdb -4.1% +1.7% -5.7% +10.9% ➖ noise
8 duckdb:vortex-file-compressed -0.5% +1.7% -2.2% +10.9% ➖ noise
9 datafusion:vortex-file-compressed +17.7% -0.2% +18.0% +10.9% 🚨 regression
9 duckdb:duckdb -0.3% -0.2% -0.1% +10.9% ➖ noise
9 duckdb:vortex-file-compressed +0.8% -0.2% +1.0% +10.9% ➖ noise
10 datafusion:vortex-file-compressed +16.4% -0.3% +16.7% +10.9% 🚨 regression
10 duckdb:duckdb -1.9% -0.3% -1.6% +10.9% ➖ noise
10 duckdb:vortex-file-compressed +0.6% -0.3% +0.9% +10.9% ➖ noise
11 datafusion:vortex-file-compressed +10.2% -0.1% +10.3% +10.9% ➖ noise
11 duckdb:duckdb -1.7% -0.1% -1.6% +10.9% ➖ noise
11 duckdb:vortex-file-compressed +3.2% -0.1% +3.3% +10.9% ➖ noise
12 datafusion:vortex-file-compressed +10.9% +0.3% +10.5% +10.9% ➖ noise
12 duckdb:duckdb -1.2% +0.3% -1.5% +10.9% ➖ noise
12 duckdb:vortex-file-compressed +1.9% +0.3% +1.6% +10.9% ➖ noise
13 datafusion:vortex-file-compressed +20.1% -1.2% +21.6% +10.9% 🚨 regression
13 duckdb:duckdb -0.8% -1.2% +0.5% +10.9% ➖ noise
13 duckdb:vortex-file-compressed +2.7% -1.2% +3.9% +10.9% ➖ noise
14 datafusion:vortex-file-compressed +16.1% +0.3% +15.8% +10.9% 🚨 regression
14 duckdb:duckdb -1.0% +0.3% -1.3% +10.9% ➖ noise
14 duckdb:vortex-file-compressed +0.1% +0.3% -0.2% +10.9% ➖ noise
15 datafusion:vortex-file-compressed +17.2% -0.4% +17.6% +10.9% 🚨 regression
15 duckdb:duckdb -1.6% -0.4% -1.2% +10.9% ➖ noise
15 duckdb:vortex-file-compressed +0.5% -0.4% +0.9% +10.9% ➖ noise
16 datafusion:vortex-file-compressed +17.4% +0.3% +17.0% +10.9% 🚨 regression
16 duckdb:duckdb +0.5% +0.3% +0.1% +10.9% ➖ noise
16 duckdb:vortex-file-compressed +2.4% +0.3% +2.1% +10.9% ➖ noise
17 datafusion:vortex-file-compressed +16.6% -0.7% +17.4% +10.9% 🚨 regression
17 duckdb:duckdb -0.0% -0.7% +0.7% +10.9% ➖ noise
17 duckdb:vortex-file-compressed +0.2% -0.7% +0.9% +10.9% ➖ noise
18 datafusion:vortex-file-compressed +24.8% -0.9% +26.0% +10.9% 🚨 regression
18 duckdb:duckdb +1.1% -0.9% +2.0% +10.9% ➖ noise
18 duckdb:vortex-file-compressed +1.7% -0.9% +2.7% +10.9% ➖ noise
19 datafusion:vortex-file-compressed +7.1% -2.3% +9.6% +38.7% ➖ noise
19 duckdb:duckdb -8.5% -2.3% -6.3% +18.3% ➖ noise
19 duckdb:vortex-file-compressed +7.0% -2.3% +9.5% +24.1% ➖ noise
20 datafusion:vortex-file-compressed +14.0% +1.9% +11.9% +106.3% ➖ noise
20 duckdb:duckdb +3.8% +1.9% +1.9% +85.8% ➖ noise
20 duckdb:vortex-file-compressed -3.8% +1.9% -5.5% +33.2% ➖ noise
21 datafusion:vortex-file-compressed +2.1% +0.1% +2.0% +10.9% ➖ noise
21 duckdb:duckdb +4.1% +0.1% +4.0% +10.9% ➖ noise
21 duckdb:vortex-file-compressed +1.7% +0.1% +1.7% +10.9% ➖ noise
22 datafusion:vortex-file-compressed +5.6% -0.1% +5.7% +10.9% ➖ noise
22 duckdb:duckdb -1.6% -0.1% -1.4% +39.4% ➖ noise
22 duckdb:vortex-file-compressed +2.1% -0.1% +2.3% +10.9% ➖ noise
23 datafusion:vortex-file-compressed +2.3% +9.4% -6.5% +30.7% ➖ noise
23 duckdb:duckdb +5.0% +9.4% -4.0% +10.9% ➖ noise
23 duckdb:vortex-file-compressed +9.8% +9.4% +0.3% +31.6% ➖ noise
24 datafusion:vortex-file-compressed -0.1% +4.7% -4.6% +14.8% ➖ noise
24 duckdb:duckdb -3.9% +4.7% -8.2% +31.0% ➖ noise
24 duckdb:vortex-file-compressed +13.0% +4.7% +8.0% +10.9% ➖ noise
25 datafusion:vortex-file-compressed +8.2% +5.0% +3.0% +11.0% ➖ noise
25 duckdb:duckdb -0.8% +5.0% -5.5% +10.9% ➖ noise
25 duckdb:vortex-file-compressed -1.7% +5.0% -6.4% +10.9% ➖ noise
26 datafusion:vortex-file-compressed -0.2% +0.6% -0.8% +11.2% ➖ noise
26 duckdb:duckdb -3.4% +0.6% -3.9% +10.9% ➖ noise
26 duckdb:vortex-file-compressed +2.0% +0.6% +1.4% +30.3% ➖ noise
27 datafusion:vortex-file-compressed +5.7% +3.6% +2.0% +10.9% ➖ noise
27 duckdb:duckdb +2.9% +3.6% -0.6% +10.9% ➖ noise
27 duckdb:vortex-file-compressed -1.6% +3.6% -4.9% +10.9% ➖ noise
28 datafusion:vortex-file-compressed +4.9% +5.4% -0.5% +10.9% ➖ noise
28 duckdb:duckdb +0.3% +5.4% -4.9% +10.9% ➖ noise
28 duckdb:vortex-file-compressed -0.7% +5.4% -5.8% +11.3% ➖ noise
29 datafusion:vortex-file-compressed +5.2% +5.4% -0.2% +13.3% ➖ noise
29 duckdb:duckdb -6.7% +5.4% -11.5% +10.9% ✅ faster
29 duckdb:vortex-file-compressed -5.7% +5.4% -10.5% +50.3% ➖ noise
30 datafusion:vortex-file-compressed +4.1% +11.8% -6.9% +10.9% ➖ noise
30 duckdb:duckdb -2.4% +11.8% -12.7% +10.9% ✅ faster
30 duckdb:vortex-file-compressed +3.1% +11.8% -7.8% +10.9% ➖ noise
31 datafusion:vortex-file-compressed +3.4% +8.4% -4.7% +10.9% ➖ noise
31 duckdb:duckdb -2.7% +8.4% -10.2% +10.9% ✅ faster
31 duckdb:vortex-file-compressed +1.0% +8.4% -6.9% +10.9% ➖ noise
32 datafusion:vortex-file-compressed +6.2% +11.3% -4.5% +10.9% ➖ noise
32 duckdb:duckdb -0.1% +11.3% -10.3% +10.9% ✅ faster
32 duckdb:vortex-file-compressed +0.5% +11.3% -9.7% +10.9% ➖ noise
33 datafusion:vortex-file-compressed +7.1% +11.3% -3.8% +10.9% ➖ noise
33 duckdb:duckdb +3.7% +11.3% -6.8% +10.9% ➖ noise
33 duckdb:vortex-file-compressed +0.7% +11.3% -9.5% +10.9% ➖ noise
34 datafusion:vortex-file-compressed +0.9% +9.1% -7.6% +10.9% ➖ noise
34 duckdb:duckdb +2.2% +9.1% -6.3% +10.9% ➖ noise
34 duckdb:vortex-file-compressed -0.4% +9.1% -8.8% +10.9% ➖ noise
35 datafusion:vortex-file-compressed +4.2% +10.4% -5.7% +10.9% ➖ noise
35 duckdb:duckdb -0.6% +10.4% -10.0% +10.9% ✅ faster
35 duckdb:vortex-file-compressed -1.6% +10.4% -10.9% +10.9% ✅ faster
36 datafusion:vortex-file-compressed -3.0% +7.2% -9.6% +12.5% ➖ noise
36 duckdb:duckdb -8.6% +7.2% -14.7% +10.9% ✅ faster
36 duckdb:vortex-file-compressed +22.6% +7.2% +14.3% +10.9% 🚨 regression
37 datafusion:vortex-file-compressed +9.1% +7.0% +1.9% +10.9% ➖ noise
37 duckdb:duckdb -10.1% +7.0% -16.0% +16.1% ✅ faster
37 duckdb:vortex-file-compressed +24.3% +7.0% +16.2% +12.8% 🚨 regression
38 datafusion:vortex-file-compressed +5.1% +0.8% +4.3% +22.0% ➖ noise
38 duckdb:duckdb -6.9% +0.8% -7.7% +10.9% ➖ noise
38 duckdb:vortex-file-compressed +25.0% +0.8% +23.9% +10.9% 🚨 regression
39 datafusion:vortex-file-compressed +2.1% +5.7% -3.4% +12.1% ➖ noise
39 duckdb:duckdb -10.3% +5.7% -15.1% +13.0% ✅ faster
39 duckdb:vortex-file-compressed +9.9% +5.7% +4.0% +10.9% ➖ noise
40 datafusion:vortex-file-compressed +3.4% +7.7% -4.0% +12.4% ➖ noise
40 duckdb:duckdb -11.2% +7.7% -17.6% +10.9% ✅ faster
40 duckdb:vortex-file-compressed +31.2% +7.7% +21.8% +13.0% 🚨 regression
41 datafusion:vortex-file-compressed +3.6% +7.7% -3.8% +13.3% ➖ noise
41 duckdb:duckdb -10.0% +7.7% -16.5% +10.9% ✅ faster
41 duckdb:vortex-file-compressed +18.9% +7.7% +10.4% +10.9% ➖ noise
42 datafusion:vortex-file-compressed +5.9% +5.1% +0.7% +15.8% ➖ noise
42 duckdb:duckdb -6.7% +5.1% -11.2% +11.1% ✅ faster
42 duckdb:vortex-file-compressed +18.5% +5.1% +12.8% +16.9% ➖ noise

@myrrc myrrc added the action/benchmark Trigger full benchmarks to run on this PR label Jun 3, 2026
@myrrc myrrc marked this pull request as ready for review June 3, 2026 11:29
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 3, 2026
@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.001x ➖
Parquet (geomean): 1.006x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
unknown / unknown (1.008x ➖, 4↑ 7↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
compress time/Arade 1106987050 1112141629 1.00
compress time/Bimbo 🚨 6918265277 5751433787 1.20
compress time/CMSprovider 2736813360 2812742584 0.97
compress time/Euro2016 473563358 480009494 0.99
compress time/Food 358177234 366923544 0.98
compress time/HashTags 861415198 853411602 1.01
compress time/TPC-H l_comment canonical 1188690996 1240012333 0.96
compress time/TPC-H l_comment chunked 1224334959 1242144067 0.99
compress time/taxi 672115799 686671219 0.98
compress time/wide table cols=100 chunks=1 rows=1000 🚀 11056473 12941572 0.85
compress time/wide table cols=100 chunks=50 rows=1000 🚨 12315552 11114255 1.11
compress time/wide table cols=1000 chunks=1 rows=1000 123213432 124570043 0.99
compress time/wide table cols=1000 chunks=50 rows=1000 121102889 123710924 0.98
compress time/wide table cols=10000 chunks=1 rows=1000 1476768104 1464525226 1.01
compress time/wide table cols=10000 chunks=50 rows=1000 1444902395 1447796421 1.00
decompress time/Arade 26283406 27020657 0.97
decompress time/Bimbo 🚨 102059095 77150155 1.32
decompress time/CMSprovider 76023406 78800584 0.96
decompress time/Euro2016 19767113 19605785 1.01
decompress time/Food 8563836 8029827 1.07
decompress time/HashTags 89124457 87996789 1.01
decompress time/TPC-H l_comment canonical 41270381 40139081 1.03
decompress time/TPC-H l_comment chunked 39868139 40138061 0.99
decompress time/taxi 14900496 14454966 1.03
decompress time/wide table cols=100 chunks=1 rows=1000 2436491 2459348 0.99
decompress time/wide table cols=100 chunks=50 rows=1000 2629613 2535489 1.04
decompress time/wide table cols=1000 chunks=1 rows=1000 23801236 22438627 1.06
decompress time/wide table cols=1000 chunks=50 rows=1000 23320862 22786453 1.02
decompress time/wide table cols=10000 chunks=1 rows=1000 255485605 254931026 1.00
decompress time/wide table cols=10000 chunks=50 rows=1000 264303764 244189287 1.08
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 🚨 2913294586 2614708624 1.11
parquet_rs-zstd compress time/Bimbo 13636079940 12644728437 1.08
parquet_rs-zstd compress time/CMSprovider 7468388342 6811335311 1.10
parquet_rs-zstd compress time/Euro2016 1302029067 1307018030 1.00
parquet_rs-zstd compress time/Food 818771197 802255554 1.02
parquet_rs-zstd compress time/HashTags 2154378147 2168974185 0.99
parquet_rs-zstd compress time/TPC-H l_comment canonical 3194322591 3205760164 1.00
parquet_rs-zstd compress time/TPC-H l_comment chunked 3229074239 3198973716 1.01
parquet_rs-zstd compress time/taxi 1203468035 1179120703 1.02
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6125216 5974973 1.03
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 5979588 5977377 1.00
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 73937676 74010630 1.00
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 73842362 73978361 1.00
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 766045768 787138311 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 777698224 769844991 1.01
parquet_rs-zstd decompress time/Arade 620731570 618606738 1.00
parquet_rs-zstd decompress time/Bimbo 1793583702 1692718559 1.06
parquet_rs-zstd decompress time/CMSprovider 1697929328 1702449662 1.00
parquet_rs-zstd decompress time/Euro2016 370731509 379872094 0.98
parquet_rs-zstd decompress time/Food 195929573 196334677 1.00
parquet_rs-zstd decompress time/HashTags 619268535 629028366 0.98
parquet_rs-zstd decompress time/TPC-H l_comment canonical 587022900 586882452 1.00
parquet_rs-zstd decompress time/TPC-H l_comment chunked 591147360 586233146 1.01
parquet_rs-zstd decompress time/taxi 246091720 242678157 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2824553 2751748 1.03
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2815645 2733747 1.03
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 32162690 31831410 1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32706776 32255752 1.01
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 344953322 346399651 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 350385114 344869323 1.02
vortex-file-compressed size/Arade 145363860 145363860 1.00
vortex-file-compressed size/Bimbo 468763396 468763396 1.00
vortex-file-compressed size/CMSprovider 417861268 417904644 1.00
vortex-file-compressed size/Euro2016 158301388 158869812 1.00
vortex-file-compressed size/Food 41927000 41927000 1.00
vortex-file-compressed size/HashTags 185286484 185405228 1.00
vortex-file-compressed size/TPC-H l_comment canonical 178491720 178346160 1.00
vortex-file-compressed size/TPC-H l_comment chunked 178462216 178410752 1.00
vortex-file-compressed size/taxi 52364012 52364012 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex:parquet-zstd ratio compress time/Arade 🚀 0 0 0.89
vortex:parquet-zstd ratio compress time/Bimbo 🚨 0 0 1.12
vortex:parquet-zstd ratio compress time/CMSprovider 🚀 0 0 0.89
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio compress time/Food 0 0 0.96
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.96
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.98
vortex:parquet-zstd ratio compress time/taxi 0 0 0.96
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 2 0.83
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚨 2 1 1.11
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 0.99
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.97
vortex:parquet-zstd ratio decompress time/Bimbo 🚨 0 0 1.25
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 0.97
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.03
vortex:parquet-zstd ratio decompress time/Food 0 0 1.07
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.03
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.03
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.99
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.02
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.07
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions

github-actions Bot commented Jun 3, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.3%
Engines: DataFusion No clear signal (-5.2%, environment too noisy confidence) · DuckDB No clear signal (+8.2%, environment too noisy confidence)
Vortex (geomean): 0.979x ➖
Parquet (geomean): 0.967x ➖
Shifts: Parquet (control) -3.3% · Median polish -0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
datafusion / vortex-file-compressed (0.985x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 688276451 680995535 1.01
tpch_q02/datafusion:vortex-file-compressed 793987647 749950058 1.06
tpch_q03/datafusion:vortex-file-compressed 777795806 815582696 0.95
tpch_q04/datafusion:vortex-file-compressed 611164439 612844507 1.00
tpch_q05/datafusion:vortex-file-compressed 936850796 1003581200 0.93
tpch_q06/datafusion:vortex-file-compressed 573035958 588483490 0.97
tpch_q07/datafusion:vortex-file-compressed 1232373990 1083100577 1.14
tpch_q08/datafusion:vortex-file-compressed 1182396136 1443183272 0.82
tpch_q09/datafusion:vortex-file-compressed 1289696193 1458435390 0.88
tpch_q10/datafusion:vortex-file-compressed 925184039 1025465162 0.90
tpch_q11/datafusion:vortex-file-compressed 425407360 446621374 0.95
tpch_q12/datafusion:vortex-file-compressed 820682023 1077035359 0.76
tpch_q13/datafusion:vortex-file-compressed 426978736 429340834 0.99
tpch_q14/datafusion:vortex-file-compressed 517027282 578905753 0.89
tpch_q15/datafusion:vortex-file-compressed 908107853 899610947 1.01
tpch_q16/datafusion:vortex-file-compressed 415195744 347739066 1.19
tpch_q17/datafusion:vortex-file-compressed 1246550026 1193730642 1.04
tpch_q18/datafusion:vortex-file-compressed 1330758900 1286924410 1.03
tpch_q19/datafusion:vortex-file-compressed 851744550 783198224 1.09
tpch_q20/datafusion:vortex-file-compressed 883851159 828039430 1.07
tpch_q21/datafusion:vortex-file-compressed 1694151664 1743707251 0.97
tpch_q22/datafusion:vortex-file-compressed 431461105 394243287 1.09
datafusion / vortex-compact (0.920x ➖, 2↑ 1↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 686186504 708696399 0.97
tpch_q02/datafusion:vortex-compact 884168744 685004623 1.29
tpch_q03/datafusion:vortex-compact 744665085 745153069 1.00
tpch_q04/datafusion:vortex-compact 🚨 1351379891 506666364 2.67
tpch_q05/datafusion:vortex-compact 900415456 951261551 0.95
tpch_q06/datafusion:vortex-compact 562309923 527517241 1.07
tpch_q07/datafusion:vortex-compact 940848190 1142573541 0.82
tpch_q08/datafusion:vortex-compact 1063700172 1318032086 0.81
tpch_q09/datafusion:vortex-compact 1190965723 1462906134 0.81
tpch_q10/datafusion:vortex-compact 🚀 829538476 1230154382 0.67
tpch_q11/datafusion:vortex-compact 471466748 617102588 0.76
tpch_q12/datafusion:vortex-compact 739947651 854490371 0.87
tpch_q13/datafusion:vortex-compact 415475539 469673795 0.88
tpch_q14/datafusion:vortex-compact 483874681 502317524 0.96
tpch_q15/datafusion:vortex-compact 852512038 938767164 0.91
tpch_q16/datafusion:vortex-compact 357800106 430548893 0.83
tpch_q17/datafusion:vortex-compact 1153130146 1235536545 0.93
tpch_q18/datafusion:vortex-compact 1092508295 1142434233 0.96
tpch_q19/datafusion:vortex-compact 757227098 873960866 0.87
tpch_q20/datafusion:vortex-compact 842692472 961834834 0.88
tpch_q21/datafusion:vortex-compact 1389733049 1848212898 0.75
tpch_q22/datafusion:vortex-compact 🚀 346090325 569610021 0.61
datafusion / parquet (1.004x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 850154878 826257138 1.03
tpch_q02/datafusion:parquet 834019769 880160397 0.95
tpch_q03/datafusion:parquet 889973388 922283049 0.96
tpch_q04/datafusion:parquet 486937391 449912749 1.08
tpch_q05/datafusion:parquet 1085882781 1146167424 0.95
tpch_q06/datafusion:parquet 520922848 511552374 1.02
tpch_q07/datafusion:parquet 1196836133 1192239671 1.00
tpch_q08/datafusion:parquet 1507217919 1521346416 0.99
tpch_q09/datafusion:parquet 1771487882 1779851241 1.00
tpch_q10/datafusion:parquet 1875218575 2046636902 0.92
tpch_q11/datafusion:parquet 483935470 496282923 0.98
tpch_q12/datafusion:parquet 682817720 651010064 1.05
tpch_q13/datafusion:parquet 679308974 706871013 0.96
tpch_q14/datafusion:parquet 754083990 836853804 0.90
tpch_q15/datafusion:parquet 1284016002 1266884068 1.01
tpch_q16/datafusion:parquet 498106113 385522756 1.29
tpch_q17/datafusion:parquet 1307870233 1312817420 1.00
tpch_q18/datafusion:parquet 1459256093 1527556752 0.96
tpch_q19/datafusion:parquet 915098405 969557936 0.94
tpch_q20/datafusion:parquet 1229083784 1150227830 1.07
tpch_q21/datafusion:parquet 1710858221 1898079821 0.90
tpch_q22/datafusion:parquet 846311373 693247301 1.22
duckdb / vortex-file-compressed (0.996x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 597561661 649403318 0.92
tpch_q02/duckdb:vortex-file-compressed 1341653816 1210959439 1.11
tpch_q03/duckdb:vortex-file-compressed 984208314 978449386 1.01
tpch_q04/duckdb:vortex-file-compressed 820581947 786191134 1.04
tpch_q05/duckdb:vortex-file-compressed 1310754908 1288483939 1.02
tpch_q06/duckdb:vortex-file-compressed 586604476 570408117 1.03
tpch_q07/duckdb:vortex-file-compressed 1343555188 1240986991 1.08
tpch_q08/duckdb:vortex-file-compressed 1478495692 1570163469 0.94
tpch_q09/duckdb:vortex-file-compressed 1781924713 1841110066 0.97
tpch_q10/duckdb:vortex-file-compressed 1180709490 1252091710 0.94
tpch_q11/duckdb:vortex-file-compressed 778470974 699829273 1.11
tpch_q12/duckdb:vortex-file-compressed 1296414826 1372885278 0.94
tpch_q13/duckdb:vortex-file-compressed 872103685 868431881 1.00
tpch_q14/duckdb:vortex-file-compressed 674605302 684588357 0.99
tpch_q15/duckdb:vortex-file-compressed 574845293 579413709 0.99
tpch_q16/duckdb:vortex-file-compressed 552408001 544224627 1.02
tpch_q17/duckdb:vortex-file-compressed 1079689537 1060224571 1.02
tpch_q18/duckdb:vortex-file-compressed 922088285 986039841 0.94
tpch_q19/duckdb:vortex-file-compressed 805239436 828937610 0.97
tpch_q20/duckdb:vortex-file-compressed 1314561279 1389992435 0.95
tpch_q21/duckdb:vortex-file-compressed 2123130070 2140205856 0.99
tpch_q22/duckdb:vortex-file-compressed 508823177 531419157 0.96
duckdb / vortex-compact (1.019x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 602583288 681376049 0.88
tpch_q02/duckdb:vortex-compact 1248680059 1178138024 1.06
tpch_q03/duckdb:vortex-compact 960682026 954011785 1.01
tpch_q04/duckdb:vortex-compact 699995443 559461941 1.25
tpch_q05/duckdb:vortex-compact 1131609965 1244784855 0.91
tpch_q06/duckdb:vortex-compact 566691139 572643542 0.99
tpch_q07/duckdb:vortex-compact 1174560727 1129997135 1.04
tpch_q08/duckdb:vortex-compact 1642839474 1404684148 1.17
tpch_q09/duckdb:vortex-compact 1658105783 1670720523 0.99
tpch_q10/duckdb:vortex-compact 1065098402 1263916368 0.84
tpch_q11/duckdb:vortex-compact 724436276 746507010 0.97
tpch_q12/duckdb:vortex-compact 1126933122 1077053844 1.05
tpch_q13/duckdb:vortex-compact 834108263 932342942 0.89
tpch_q14/duckdb:vortex-compact 651308080 691494300 0.94
tpch_q15/duckdb:vortex-compact 590654062 591825411 1.00
tpch_q16/duckdb:vortex-compact 447864443 399029951 1.12
tpch_q17/duckdb:vortex-compact 991514788 944346784 1.05
tpch_q18/duckdb:vortex-compact 897949326 858242196 1.05
tpch_q19/duckdb:vortex-compact 791685852 771601502 1.03
tpch_q20/duckdb:vortex-compact 1436554807 1184958226 1.21
tpch_q21/duckdb:vortex-compact 1800568962 1875113803 0.96
tpch_q22/duckdb:vortex-compact 540016819 489959943 1.10
duckdb / parquet (0.931x ➖, 0↑ 0↓)
name PR 6c1444c (ns) base 2d00342 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 829896796 923941939 0.90
tpch_q02/duckdb:parquet 1336767316 1581689419 0.85
tpch_q03/duckdb:parquet 1639240386 1782834489 0.92
tpch_q04/duckdb:parquet 973148284 1103264248 0.88
tpch_q05/duckdb:parquet 1890415229 2100248810 0.90
tpch_q06/duckdb:parquet 727660717 914085486 0.80
tpch_q07/duckdb:parquet 1676849187 1836279752 0.91
tpch_q08/duckdb:parquet 2236479285 2413264044 0.93
tpch_q09/duckdb:parquet 2442632472 2742150724 0.89
tpch_q10/duckdb:parquet 2901992691 3198172673 0.91
tpch_q11/duckdb:parquet 940525102 1028677066 0.91
tpch_q12/duckdb:parquet 1057598542 1329506129 0.80
tpch_q13/duckdb:parquet 1246749946 1349352353 0.92
tpch_q14/duckdb:parquet 1316427354 1225896565 1.07
tpch_q15/duckdb:parquet 975686613 943970815 1.03
tpch_q16/duckdb:parquet 949173009 915991914 1.04
tpch_q17/duckdb:parquet 1282954065 1385712218 0.93
tpch_q18/duckdb:parquet 1504934849 1499917492 1.00
tpch_q19/duckdb:parquet 1623543390 1606814517 1.01
tpch_q20/duckdb:parquet 1866994980 2016013003 0.93
tpch_q21/duckdb:parquet 1805121721 1896258061 0.95
tpch_q22/duckdb:parquet 1213172056 1137246028 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -3.2% -3.9% +0.7% +36.3% ➖ noise
1 datafusion:vortex-file-compressed +1.1% -3.9% +5.1% +40.4% ➖ noise
1 duckdb:vortex-compact -11.6% -3.9% -8.0% +33.8% ➖ noise
1 duckdb:vortex-file-compressed -8.0% -3.9% -4.3% +30.0% ➖ noise
2 datafusion:vortex-compact +29.1% -10.5% +44.2% +37.8% 🚨 regression
2 datafusion:vortex-file-compressed +5.9% -10.5% +18.3% +37.6% ➖ noise
2 duckdb:vortex-compact +6.0% -10.5% +18.4% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +10.8% -10.5% +23.8% +31.3% ➖ noise
3 datafusion:vortex-compact -0.1% -5.8% +6.1% +44.7% ➖ noise
3 datafusion:vortex-file-compressed -4.6% -5.8% +1.2% +47.9% ➖ noise
3 duckdb:vortex-compact +0.7% -5.8% +6.9% +33.4% ➖ noise
3 duckdb:vortex-file-compressed +0.6% -5.8% +6.8% +39.8% ➖ noise
4 datafusion:vortex-compact +166.7% -2.3% +173.0% +74.1% 🚨 regression
4 datafusion:vortex-file-compressed -0.3% -2.3% +2.1% +30.0% ➖ noise
4 duckdb:vortex-compact +25.1% -2.3% +28.1% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +4.4% -2.3% +6.8% +30.0% ➖ noise
5 datafusion:vortex-compact -5.3% -7.7% +2.5% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -6.6% -7.7% +1.1% +30.0% ➖ noise
5 duckdb:vortex-compact -9.1% -7.7% -1.6% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +1.7% -7.7% +10.2% +30.0% ➖ noise
6 datafusion:vortex-compact +6.6% -10.0% +18.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -2.6% -10.0% +8.2% +30.0% ➖ noise
6 duckdb:vortex-compact -1.0% -10.0% +9.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +2.8% -10.0% +14.2% +30.0% ➖ noise
7 datafusion:vortex-compact -17.7% -4.3% -14.0% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +13.8% -4.3% +18.8% +30.0% ➖ noise
7 duckdb:vortex-compact +3.9% -4.3% +8.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +8.3% -4.3% +13.1% +30.0% ➖ noise
8 datafusion:vortex-compact -19.3% -4.2% -15.8% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -18.1% -4.2% -14.5% +30.0% ➖ noise
8 duckdb:vortex-compact +17.0% -4.2% +22.1% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -5.8% -4.2% -1.7% +30.0% ➖ noise
9 datafusion:vortex-compact -18.6% -5.8% -13.5% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -11.6% -5.8% -6.1% +30.0% ➖ noise
9 duckdb:vortex-compact -0.8% -5.8% +5.4% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -3.2% -5.8% +2.8% +30.0% ➖ noise
10 datafusion:vortex-compact -32.6% -8.8% -26.0% +30.0% ✅ faster
10 datafusion:vortex-file-compressed -9.8% -8.8% -1.1% +30.0% ➖ noise
10 duckdb:vortex-compact -15.7% -8.8% -7.6% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -5.7% -8.8% +3.4% +30.0% ➖ noise
11 datafusion:vortex-compact -23.6% -5.6% -19.1% +36.3% ➖ noise
11 datafusion:vortex-file-compressed -4.7% -5.6% +0.9% +30.0% ➖ noise
11 duckdb:vortex-compact -3.0% -5.6% +2.8% +30.4% ➖ noise
11 duckdb:vortex-file-compressed +11.2% -5.6% +17.8% +30.0% ➖ noise
12 datafusion:vortex-compact -13.4% -8.7% -5.2% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -23.8% -8.7% -16.6% +30.0% ➖ noise
12 duckdb:vortex-compact +4.6% -8.7% +14.5% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -5.6% -8.7% +3.4% +30.0% ➖ noise
13 datafusion:vortex-compact -11.5% -5.8% -6.1% +30.0% ➖ noise
13 datafusion:vortex-file-compressed -0.6% -5.8% +5.5% +30.0% ➖ noise
13 duckdb:vortex-compact -10.5% -5.8% -5.1% +30.0% ➖ noise
13 duckdb:vortex-file-compressed +0.4% -5.8% +6.6% +30.0% ➖ noise
14 datafusion:vortex-compact -3.7% -1.6% -2.1% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -10.7% -1.6% -9.2% +30.0% ➖ noise
14 duckdb:vortex-compact -5.8% -1.6% -4.2% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -1.5% -1.6% +0.2% +30.0% ➖ noise
15 datafusion:vortex-compact -9.2% +2.4% -11.3% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +0.9% +2.4% -1.4% +30.0% ➖ noise
15 duckdb:vortex-compact -0.2% +2.4% -2.5% +36.8% ➖ noise
15 duckdb:vortex-file-compressed -0.8% +2.4% -3.1% +30.0% ➖ noise
16 datafusion:vortex-compact -16.9% +15.7% -28.2% +30.0% ✅ faster
16 datafusion:vortex-file-compressed +19.4% +15.7% +3.2% +30.0% ➖ noise
16 duckdb:vortex-compact +12.2% +15.7% -3.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +1.5% +15.7% -12.3% +30.0% ➖ noise
17 datafusion:vortex-compact -6.7% -4.0% -2.8% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +4.4% -4.0% +8.7% +30.0% ➖ noise
17 duckdb:vortex-compact +5.0% -4.0% +9.3% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +1.8% -4.0% +6.0% +30.0% ➖ noise
18 datafusion:vortex-compact -4.4% -2.1% -2.3% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +3.4% -2.1% +5.6% +30.0% ➖ noise
18 duckdb:vortex-compact +4.6% -2.1% +6.9% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -6.5% -2.1% -4.5% +30.0% ➖ noise
19 datafusion:vortex-compact -13.4% -2.3% -11.3% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +8.8% -2.3% +11.4% +30.0% ➖ noise
19 duckdb:vortex-compact +2.6% -2.3% +5.1% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -2.9% -2.3% -0.5% +30.0% ➖ noise
20 datafusion:vortex-compact -12.4% -0.5% -11.9% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +6.7% -0.5% +7.3% +30.0% ➖ noise
20 duckdb:vortex-compact +21.2% -0.5% +21.9% +30.0% ➖ noise
20 duckdb:vortex-file-compressed -5.4% -0.5% -4.9% +30.0% ➖ noise
21 datafusion:vortex-compact -24.8% -7.4% -18.8% +30.0% ➖ noise
21 datafusion:vortex-file-compressed -2.8% -7.4% +4.9% +30.0% ➖ noise
21 duckdb:vortex-compact -4.0% -7.4% +3.7% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -0.8% -7.4% +7.1% +30.0% ➖ noise
22 datafusion:vortex-compact -39.2% +14.1% -46.8% +33.1% ✅ faster
22 datafusion:vortex-file-compressed +9.4% +14.1% -4.1% +30.0% ➖ noise
22 duckdb:vortex-compact +10.2% +14.1% -3.4% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -4.3% +14.1% -16.1% +30.0% ➖ noise

@myrrc myrrc enabled auto-merge (squash) June 3, 2026 12:12
@myrrc myrrc disabled auto-merge June 3, 2026 12:12
@myrrc myrrc enabled auto-merge (squash) June 3, 2026 12:13
joseph-isaacs
joseph-isaacs reviewed Jun 3, 2026
View reviewed changes
Comment thread vortex-layout/src/layouts/chunked/mod.rs
Comment on lines 105 to 140
@@ -135,12 +131,11 @@ pub struct ChunkedLayout {

impl ChunkedLayout {
pub fn new(row_count: u64, dtype: DType, children: Arc<dyn LayoutChildren>) -> Self {
let mut chunk_offsets = Vec::with_capacity(children.nchildren() + 1);

chunk_offsets.push(0);
let mut chunk_offsets = vec![0; children.nchildren() + 1];
for i in 0..children.nchildren() {
chunk_offsets.push(chunk_offsets[i] + children.child_row_count(i));
chunk_offsets[i + 1] = chunk_offsets[i] + children.child_row_count(i);
}

assert_eq!(
chunk_offsets[children.nchildren()],

@joseph-isaacs joseph-isaacs Jun 3, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

revert or use mut iter if you want perf

@myrrc myrrc merged commit 7a53ad5 into develop Jun 3, 2026
112 of 116 checks passed
@myrrc myrrc deleted the myrrc/chunked-layout-offsets branch June 3, 2026 12:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@joseph-isaacs joseph-isaacs joseph-isaacs approved these changes

Assignees

No one assigned

Labels

changelog/performance A performance improvement

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@myrrc @joseph-isaacs